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Abstract 

We develop a new framework for modeling innovation networks which evolve over time. 
The nodes in the network represent firms, whereas the directed Hnks represent unilateral 
interactions between the firms. Both nodes and links evolve according to their own dynamics 
and on different time scales. The model assumes that firms produce knowledge based on the 
knowledge exchange with other firms, which involves both costs and benefits for the partici- 
pating firms. In order to increase their knowledge production, firms follow different strategies 
to create and/or to delete links with other firms. Dependent on the information firms take 
into account for their decision, we find the emergence of different network structures. We 
analyze the conditions for the existence of these structures within a mathematical approach 
and underpin our findings by extensive computer simulations which show the evolution of 
the networks and their equilibrium state. In the discussion of the results, particular attention 
is given to the emergence of direct and indirect reciprocity in knowledge exchange, which 
refers to the emergence of cycles in the network structure. 

In order to motivate our modeling framework, in the first part of the chapter we 
give a broad overview of existing literature from economics and physics. This shows that 
our framework bridges and extends two different lines of research, namely the study of 
equihbrium networks with simple topologies and the dynamic approach of hypercycle models. 

Keywords: Catalytic Networks, Innovation Networks, R&D Collaborations, Network 
Formation 



1 Introduction 



1.1 The Importance of Innovation Networks 

Economists widely a gree on technologica l change and innov ation being the main components 



of economic growth (lAghion and Howitt 



1998 



Tirold . Il988l ) . In the absence of ongoing tech- 



nolog ical improvements economic growth can hardly be maintained (jBarro and Sala-i Martin 



2004 ). The close link between innovation and economic performance has become generally ac- 
cepted. Following this insight, in recent years of eco nomic growth , OECD countries have fostered 
investments in science, technology and innovation (IOECDI . 12000 ) . 
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Moreover, technologies are becoming increasingly complex. This increasing complexity of tech- 
nologies can make an agent's "in-house" innovative effort insufficient to compete in an R&D 
intensive economy. Thus, agents have to become more specialized on specific domains of a tech- 
nology and they tend to rely on knowledge transfers from other agents, which are specialized 
in different domains, in order to combin e complementary domains of knowledge for production 
("recombinant growth" |Weitzmanl . Il998l )). 

When one agent benefits from knowledge created elsewhere we speak of knowledge spillovers. 
Knowledge spillovers define "any original, valuable knowledge generated so mewhere that becomes 
accessible to external agents ... other than the originator.'tj (|Forayl . 12004 p. 95) 

The knowledge-based economy is developing towards a state in which the costs for acquiring, 
reproducing and transmitting knowledge are constantly decreasing, spatial and geographical 
limitations on knowledge exchange are becoming less important and attitudes change towards 
more open behavior of sharing knowledge instead of hiding it from others. In this state, knowledge 
externalities will play an increasingly important role. 

When agents are using knowledge that is created elsewhere, they must have access to other 
agents across a network whose links represent the exchange or transfer of knowledge between 
agents. The importance of networks in innovative economies has been widely recognized, e.g. it 
has been observed that "the development of knowl edge within indu stries is strongly influenced by 
the network structure of relations among agents" (lAntonellil . Il996l . p. 1). Subsequently, an ample 
body of empirical resear ch has documented the steady growth of R&D partnerships among firms 
(jHagedoorn et all l2006l ). 



1.1.1 Markets for Knowledge Exchange 



The exchange of knowl edge is not unproblematic. Marke ts for knowledge exchange can exhibit 
serious market failures ([Geroskyl . Il995l : lArora et all 12004 ) which make it difficult for innovators 
to realize a reas onable return f rom trading the results of their R&D activities (the problem of 
appropriability (jGeroskyl . Il995l )). This is due to the public good character of knowledge, which 
makes it different from products or services. Knowledge is non-rival, meaning its use by one 
agent does not diminish its usability by another agent, and sometimes (when knowledge spillovers 
cannot be avoided) non-excludable, meaning that the creator of new knowledge cannot prevent 
non-payers from using it. The problems associated with trading of knowledge can prevent agents 
from exchanging knowledge at all. 



There are three generic 


1995; 


Arora et al. 


20041 



(1) economies of scale/scope, (2) uncertainty and (3) externalities. 



^"Involuntary spillovers are a feature of market competition. Competition not only creates incentives to produce 
new knowledge but it also forces the other agents to incre ase the i r own performance through imitation, adoption 
and absorption of the new knowledge created elsewhere." I Foray . 20041 . p. 91) 
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(1) R&D projects often require huge initial investments and they can exhibit economies of scale 
since the cost for useful techn ological in formati o n per unit of output declines as the level of 
output increases (IWilsonl . Il975l ). Besides. iNelsonI (119591 ) has shown that economies of scope can 
apply to innovative agents. The broader an agents' "technological base", the more likely it is that 
any outcome of its R&D activities will be useful for her. The result is that markets for knowledge 
exchange are often dominated by monopolies. 

(2) Almost all economic investments bear a risk of how the market will respond to the new 
product (commercial success). Innovators face additional risks. First, their investment into R&D 
does not necessarily lead to a new technology. Second, if such a new technology is discovered, 
it has to be put into practice in a new and better product than the already existing ones. This 
inherent uncertainty of R&D projects often causes agents to invest "too little". 

(3) Externalities are important when the action of one agent influences the profits of another 
agent without compensation through the market. Public goods are a typical example of creating 
externalities. Knowledge is a public good and the returns innovators can realize often are far 
below their investments into R&D. This can seriously diminish an agent's incentive to do R&D. 

In order to overcome the above mentioned problems associated with the returns on investment 
into R&D appropriate incentive mechanisms have t o be c reated that encourage agents to invest 
into R&D. In general, I Von Hipp el and Von Kroghl (j2003l ) suggest three basic models of encour- 
aging agents to invest into R&D: 

(1) , the private investment model assumes that innovation is undertaken by private agents in- 
vesting their resources to create an innovation. Society then provides agents with limited rights 
to exclusively use the results of their innovation through patents or other intellectual property 
rights (by creating a temporarly monopoly jl. 

(2) , the so called collective action model (lAllenl . 1983) assumes that agents are creating knowl- 
edge as a public good. Knowledge is made public and unconditionally supplied to a public pool 
accessible to everybody. The problem is that potential beneficiaries could wait until others pro- 
vide the public good and thereby could free-ride. One solution to this problem is to provide 
contributors (in this case innovators) with some form of subsidy. Scientific research is such an 
example where reputation based rewards are granted to scientists for their good performance. 

(3) , in the private-collective innovation model participants use their private resources in creating 
new knowledge and then make it public ly available. This is typi c ally observed in open source 
proje cts. There are several incentives (ILerner and Tirold . l2002l : I Von Hipp el and Von Kroghl . 
2QQ3I ) for agents to participants in open-source projects. These range from elevated reputa- 
tions, the desire of building a community to the expectation of reciprocity from the community 
members for their efforts. 

The collective action approach (2) gives a possible explanation for the willingness of agents to 
share knowledge if there are no costs associated with it. One can think of a pool of technologies 



For a more detailed treatment of this issue we recommend IScotchmej l|2004l l 
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that is accessible to everybody ("broadcasting" of technologies) (|Allenl . ll983l ). This can be the case 
where agents are non-rivals and shared information may have no competitive cost. Additionally, 
knowledge must be easily understandable and transferable. This assumes that knowledge is highly 
codifieqj such that the transfer of knowledge from one agent to the other is costless. But, if 
these assumptions do not hold, the costs for transferring knowledge can often be considerable, 
and agents become more selective about whom to share their knowledge with. We study this 
situation in the next sections. 



1.2 Economies as Evolving Networks 



As we already outlined above, modern economies are becoming increasingly networked, and this 
also affects the innov ation process where information and knowle dge are exchanged by interac- 
tions between agents (IKirmanl . 119971 : iGallegati and Kirmanl . Il999l ). In the agent based view, the 
aggregate behavior of the economy (macroeconomics) cannot be investigated in terms of the be- 
havior of isolated individuals. Not only there are different ways in which firms interact, learning 
over time, based on their previous experience; also interactions between them take place within 
a network and not in a all-to-all fashion. 

The standard neoclassical mode0 of the economy assumes that anonymous and autonomous 
individuals take decisions independently and interact only through the price system which they 
cannot influence at all. However, competition easily becomes imperfect because, if agents have 
only a minimal market power, they will anticipate the consequences of their actions and anticipate 
the actions of others. 

Game theorists have tried to integrate the idea of strategically interacting agents into a neo- 
classical framework. But still they leave two questions unanswered. First, it is assumed that 
the behavior is fully optimizing. This leads to agents with extremely sophisticated information 
processing capabilities. Such ability of passing these enormous amounts of information in short 
times cannot be found in any realistic setting of huma n interaction. Advance s in w eakening that 
assumption are referred to as "boundedly rationality" (iGigerenzer and Seltenl . l2002l ). Second, the 



^The opposite case of codified knowledge is tacit knowledge. "Tacit knowledge is difficult to make explicit for 
transfer and reproduction. The exchange, diff^usion, and learning of tacit knowledge require those who have it to 
take deliberate action to share it. This is difficult and costly to implement ... Knowledge can, however, be codified. 
It can be expressed in a particular language and recorded on a particular m edium . As su ch, it is detached from 
the individual. When knowledge is codified, it becomes easily transfe rable." I Foray . 20o3 . p. 73) 

''a standard neoclassical model includes the following assumptions I Gabszewicj . 2000l l: f 11 perfect competition, 
(2) perfect information, (3) rational behavior, (4) all prices are fiexi ble (all markets are in equilibrium). The 
resulting market equilibrium (allocation of goods) is then efficient. See Hausman 1 2003[ ) for a discussion of these 
assumptions. 

^The individual decision making process is represented as maximizing a utility function. A utility function 
is a way of assigning a number to eve ry possible choice such that more-preferred choices have a higher number 
than less-preferred ones l|Varianl . [l99i l. The gradients of the utility function are imagine d to be like fo r ces dr iving 



people to trade, and from which economic equilibria emerge as a kind of force balance ijFarmer et al\ . l2005l l 
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problem of coordination of activities is not addressed in the standard equilibrium model of the 
economy. Instead it is assumed that every agent can interact and trade with every other agent, 
which becomes quite unrealistic for large systems. 

One has to specify the framework within the individual agents take price decisions and thus limit 
the environment within which they operate and reason. An obvious way is to view the economy 
as a network in which agents interact only with their neighbors. In the case of technological 
innovation, neighbors might be similar firms within the same industry, but these firms will then 
be linked either through customers or suppliers with firms in other industries. Through these 
connections innovations will diffuse through the network. The rate and extent of this diffusion 
then depends on the structure and connectivity of the network. The evolution of the network 
itself should be made endogenous where the evolution of the link structure is dependent on the 
agents' experience from using the links available to them. In this framework the individuals learn 
and adapt their behavior and this in turns leads to an evolution of the network structure. The 
economy then becomes a complex evolving network. 



1.2.1 Complex Networks 

Although no precise mathematical definition exists for a complex network, it is worth to elaborate 
the notion associated with it. In general, a network is a set of items some of which are linked 
together by pairwise relationships. The structure of the relationships can be represented math- 
ematically as a graph in which nodes are connected by links (possibly with varying strength). 
However a network is usually also associated with some dynamic process on the nodes which in 
turn affects the structure of the relationships to other nodes. A wide variety of systems can be 
described as a network, ranging from cells (a set of chemicals connected by chemical reactions), 
to the Internet (a set of routers linked by physical information channels). It is clear that the 
structure of the relationships co-evolves with the function of the items involved. 

As a first step, a network can be described simply in terms of its associated grapljfl. There are 
two extreme cases of relatively simple graphs: regular lattices on one side and random gra phfl 
on the other side. During the last century, graph theory and statistical physics have developed a 
body of theories and tools to describe the behavior of systems represented by lattices and random 
graphs. However, it turns out that, at least for physical scales larger than biomolecules, most 
systems are not structured as lattices or as random graphs. Moreover, such a structure is not the 
result of a design, but it emerges from self-organization. In some cases self-organization results 



^In general a graph represents pairwise relations between objects from a certain collection. A graph then 
consists of a collection of nodes and a collection of links that connect pairs of nodes. 

The classical Erdos-Reny random graph is defined by the following rules (BoUobaf, IQSSl l: 

(1) The total number of nodes is fixed. 

(2) Randomly chosen pairs of nodes are connected by links with probability p. 

The construction procedure of such a graph may be thought of as the subsequent addition of new links between 
nodes chosen at random, while the total number of nodes is fixed. 
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from the attempt to optimize a global function. In other cases, as it is typical in economics, it 
results from nodes locally trying to optimize their goals, e.g. an individual utility function. 

Large networks are collectively designated as complex networks if their structure (1) is coupled 
to the functionality, (2) emerges from self-organization, and (3) deviates from trivial graphs. 
This definition incl udes many larg e systems of enormous technological, intellectual, social and 



economical impact (iFrenkenl . 12009 ) 



1.3 The Statistical Physics Approach 

As we will discuss later, many of the theoretical tools developed in economics and specifically 
in game theory to characterize the stability of small networks of firms cannot be used for large 
networks. Asking which is the optimal set of connections that a firm should establish with other 
firms has little meaning in a large network if strategic interaction is taken into account (with 
more than say, 100 nodes it is simply not feasible to compute). On the other hand, it makes 
sense to ask what are connectivity properties of the nodes a firm should try to target in order 
to improve its utility with a certain probability. It is then necessary to turn towards a statistical 
description of these systems, where one is no longer interested in individual quantities but only 
in averaged quantities. 

There exists an arsenal of such tools developed within statistical physics in the last century, that 
allow to predict the macroscopic beh avior of a system from the local properties of its constituents 



(jPurlaui I1999I : IStanley et q/.I . Il999l ). Such tools work very well for systems of identical particles 
embedded in regular or random network structures in which interactions depend on physical 
distance. Both a regular and a random structure have a lot of symmetries, which one can exploit 
to simplify the description of the system. However, in complex networks many of those symmetries 
are broken: individuals and interactions are heterogeneous. Moreover the physical distance is often 
irrelevant (think for instance of knowledge exchange via the Internet). Therefore, a satisfactory 



descr iption of such systems represents a major challenge for statistical physics (lAmaral et al 



2001 



In the last few years we have thus witnessed an increasing interest and effort within the field of 
statistical physics in studying complex networks that traditionally were object of investigation 
by other disciplines, ranging from biology to computer science, linguistics, politics, anthropology 
and many others. One of the major contributions of statistical physics to the field of complex 
networks has been to demonstrate that several dynamic processes taking place on networks that 
deviate from random graphs, exhibit a behavior dramatically different from the ones observed 
on random graphs. 

An example for all is the case of virus spreading: it has been shown that while for random 
networks a local infection spreads to the whole network only if the spreading rate is larger than 
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a critical value, for scale-free networkqj any spreading rate leads to the infection of the whole 
network. Now, technological as well as social networks are much better described as scale free 
graphs than as random graphs. Therefore all vaccination strategies for both computer and human 
viruses, which have been so far designed based on the assumption that such networks were random 
graphs, need to be revised. This highly unexpected result goes against volumes previously written 
on this topic and is due to the presence of a few nodes with very large connectivity. In this case, 
the rare events (infection of highly connected nodes) and not the most frequent ones matter. 

Explaining the macroscopic behavior of a system in terms of the properties of the constituents 
has been a major success of the physicist's reductionist approach. But, while in physical systems 
the forces acting on single constituents can be measured precisely, this is not the case in a socio- 
economic system where, moreover, each agent is endowed with high internal complexity. Today, 
the physicist's approach to socio-economic systems differs from the nineteenth century positivist 
approach in so far as it does not aim at predicting, for instance the behavior of individual 
agents. Instead, taking into account the major driving forces in the interactions among agents 
at the local level we try to infer, at a system level, some general trends or behavior that can be 
confirmed looking at the data. This is also very different from taking aggregate quantities and 
infer a macroscopic behavior from a "representative" agent§| as it is done in several approaches 
in mainstream economics. 



1.3.1 Dynamics versus Evolution in a Network 



After discussing the notion of a complex network which has been strongly influenced by physics, 
we now try to classify different complex networks. 

The nodes in an economic network are associated with a state variable, representing the agents' 
wealth, a firm's output or, in the case of innovation networks, knowledge. There is an important 
difference between the evolution of the network and the dynamics taking place on the state 
variables. In the first, nodes or links are added to/removed from the network by a specific 
mechanism and in the latter, t he state variables are ch anged as a result of the interactions 
among connected nodes (see also lGross and Blasiud (|2007l ) for a revie w). Consequently , there are 
four aspects that can be investigated in complex economic networks (IBattistonl . l2003l ). 



1. statistic characterization of the static network topology without dynamics of state variables. 



*A scale-free network is characterized by a degree distribution which follows a power law, f{d) = ad''. The 
degree distribution gives the number of agents with a certain number, d, of in- or outgoing links (in- or outdegree), 
see the next section for a definition of degree of a node. 

^The concept of the representative agent assumes an economy which consists of a sufficiently homogeneous 
population of agents. Because all the agents are equivalent, the aggregate quantities of the system can be calculated 
by multiplying the average agent, or the representative agent, by the number of agents (the system size). For 
example the total production of an economy is obtained by summing up the production levels of the individual 
firms that constitute the economy. To determine the behavior of the system it is therefore sufficient to know the 
characteristics of the representative agent. 
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2. Network evolution without dynamics of the state variables, 

3. Dynamics of state variables in a static network and 

4. Dynamics of state variables and evolution of the network at the same time. 
This can be incorporated in the following table. 



case 


state variables 


network 


1. 


static 


static 


2. 


dynamic 


static 


3. 


static 


dynamic 


4. 


dynamic 


dynamic 



Table 1: Overview of the different ways in which a network and the state variables of the nodes 
can be related. 



In socio-economic systems as well as in biological systems, dynamics and evolution are often 
coupled, but do not necessarily have the same time scale. In section we will show how 
the coupling of fast knowledge growth (dynamics) and slow network evolution can lead to the 
emergence of self-sustaining cycles in a network of knowledge sharing (cooperating) agents. 



1.4 Outline of this Chapter 

In this chapter we focus on (i) the emergence and (ii) the performance of different structures 
in an evolving network. The different scenarios we develop shall be applied to firms exchanging 
knowledge in a competitive, R&D intensive economy. In the existing literature reviewed in the 
following section, there are two different lines of research addressing these proble ms: (i) M o dels o f 
network formation were developed based on individual utility functions, e.g. by Jackson (|2003l ). 



in which simp l e arch itectures emerge in the equilibrium, (ii) In another group of models, e.g. 



Padgett et ali (|2Q03l ). firms have specific skills and take actions based on goals or learning and 
innovation is associated with the emergence of self-sustaining cycles of knowledge production. 
Although both lines of work address the problem of network emergence and performance, they 
differ significantly in terms of methods and results. We try to bridge them by introducing a novel 
model of evolving innovation networks that combines the topological evolution of the network 
with dynamics associate with the network nodeJ^. 

We start our approach by giving a short introduction to graph theory in section (12. Here we 
restrict ourselves only to the most important terms and definitions that are necessary in the 
following sectionJ^. 



^°The approach of co mbining a dynamics of the network with a dynamics in the nodes is discussed in 
Gross and Blasiu j l|2007l l. 



^^The reader interested in more details in graph theory can consult West llioOl 
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We then proceed by giving an overview of the existing hterature on economic networks. In the first 
part of our hterature review we explore some basic models of innovation networks. The selection 
of these models is by no means unique nor exhaustive, but points to important contributions 
to the growing literature on economic and innovation networkJ^. Similar to our own approach, 
these models make considerably simple assumptions and thus allow for analytical insights. This 
holds in particular for the connections model in section (|2.2p . The model in section (12. 3p can be 
considered as an extension of the basic connections model where "small world" networks emerge. 
In the subsequent section, (|2.4|) . we discuss a model that takes heterogeneous knowledge into 
account, as a further extension. In the second part of the literature review we briefly sketch 
models in which we observe cyclic network topologies. We show that in certain cases the stability 
of a network and its performance depends critically its c yclic structure. Th e critical role of cycles 



in a networke d econorny has al ready been ident i fied b y iRosenblattI (Il957l'l and many succeeding 
authors, e.g. iMaxfieldl dlQpA : bala, and Gova3 hood ): Ixim and Wongl kopj ). In this chapter 
we review some recent models in which cyclic networks emerge: in section (|2.5.1|1 a model of 
production networks with closed loops is presented and in section (|2.5.2|) we introduce a model 
of cycles of differently skilled agents. 

Finally, in section ([3|) we develop a novel framework, which we call Evolving Innovation Networks, 
to study the evolution of innovation networks. We show how different modalities of interactions 
between firms and cost functions related to these interactions can give rise to completely differ- 
ent equilibrium net works. We have studied the case of linear cost and bilateral interactions in 



Konig et 'aH (I2nn7bl lal). There we find that, depending on the cost, the range of possible equilib- 
rium networks contains complete, intermediate graphs with heterogeneous degree distributions 
as well as empty graphs. Here, we focus on a type of nonlinear cost and both, on unilateral and 
bilateral interactions. In the unilateral case, we find that, in a broad range of parameter values, 
networks can break down completely or the equilibrium network is very sparse and consists of 
few pairwise interactions and many isolated agents. Equilibrium networks with a higher density 
can be reached if (i) the utility function of the agents accounts for a positive externality result- 
ing from being part of a technological feedback loop or if (ii) all interactions are bidirectional 
(direct reciprocal). Otherwise the network collapses and only few, if any, agents can beneficially 
exchange knowledge. 

The results found in our novel approach to evolving innovation networks are summarized in 
section (|6.1|) . The appendix shall be useful for the reader interested in more numerical results 
and the parameters and explanation of the algorithms used. 



For an excellent introduction see IjacksonI l|2007l l. IVega-Redondj l|2007l l and lCovaJ l|2007l l 
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2 Basic Models of Innovation Networks 
2.1 Graph Theoretic Network Characterization 

Before we start to describe specific models of economic networks, we give a brief introduction to 
the most important graph theoretic terms used throughout this chapter to characterize networks. 



For a broader introduction to graph theory see I WestI (120011 ) . In this chapter we will use the terms 



graph and network interchangeably, i.e. both refer to the same object. The same holds for nodes 
and nodes as well as links and links. 

A graph G is a pair, G = {V,E), consisting of a node set V{G) and an link set E{G). Kn is the 
complete graph on n nodes. Cn the cycle on n nodes. Nodes i and j are the endpoints of the link 
e^, G E{G). 

The degree^ di, of a node i is the number of links incident to it. A graph can either be undirected 
or directed, where in the latter case one has to distinguish between in-degree, , and out- 
degree, df , of node i. In the case of an undirected graph, the neighborhood of a node i in 
G is Ni = {w £ V{G) : e^i £ E{G)}. The degree of a node i is then di = \Ni\. The first 
order neighborhood is just the neighborhood, Ni, of node i. The second order neighborhood is, 
Ni U {Ny : V G Ni}. Similarly, higher order neighborhoods are defined. In the case of a directed 
graph we denote the out-neighborhood of node i by and the in-neighborhood by Nf . A 
graph G is regular if all nodes have the same degree. A graph G is k — regular if every node has 
degree k. 

A walk is an alternating list, {vo,eoi,vi, ...,Vk-i,ek~ik,Vk}, of nodes and links. A trail is a walk 
with no repeated link. A path is a walk with no repeated node. The shortest path between two 
nodes is also known as the geodesic distance. If the endpoints of a trail are the same (a closed 
trail) then we refer to it as a circuit. A circuit with no repeated node is called a cycle. 

A subgraph, G' , of G is the graph of subsets of the nodes, V{G') C V{G), and links, E{G') C 
E{G). A graph G is connected, if there is a path connecting every pair of nodes. Otherwise G is 
disconnected. The components of a graph G are the maximal connected subgraphs. 

The adjacency matrix, A{G), of G, is the n-by-n matrix in which the entry is 1 if the link 
Cij G E{G), otherwise aij is 0. For an undirected graph A is symmetric, i.e. Ojj = Oji Vi, j G ViG). 
An example of a graph and its associated adjacency matrix is given in Fig. ([T|). For example, in 
the first row with elements, an = 0, ai2 = 1, ais = 0, ai4 = 0, the element ai2 = 1 indicates that 
there exist an link from node 1 to node 2. 

In a bipartite graph G, V{G) is the union of two disjoint independent sets Vi and V2. In a 
bipartite graph, if ei2 G E{G) then vi G Vi and U2 G V2. In other words, the two endpoints of 
any link must be in different sets. The complete bipartite graph with partitions of size l^il = n 
and 11/21 = is denoted Kn,m- A special case is the star which is a complete bipartite graph 
with one partition having size n = 1, Ki^m- 
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Figure 1: (Right) a directed graph consisting of 4 nodes and 5 hnks. (Left) the corresponding 
adjacency matrix A 



There exists an important class of graphs, random graphs, which are determined by the ir number 



of no des, n, and the (independent) probabihty p of each hnk being present in the graph (jBollobas 



19851). 



Newman ( 


2003 


) and 


Costa et al. 


(2007) 



definitions assume undirected graphs. 

For each node, the local clustering coefficient, Ci, is simply defined as the fraction of pairs of 
neighbors of i that are themselves neighbors. The number of possible neighbors of node i is 
simply di{di — l)/2. Thus we get 



\{ejk G E{G) : e,j € E{G) A e,k G E{G)}\ 



di{di - l)/2 

The global clustering coefficient C is then given by 



(1) 



C 



n 

n ^-^ 



(2) 



i=l 



A high clustering coefficient C means (in the language of social networks), that the friend of your 
friend is likely also to be your friend. It also indicates a high redundancy of the network. 

The average path length I is the mean geodesic (i.e. shortest) distance between node pairs in a 
graph: 

1 " 

where dij is the geodesic distance from node i to node j. 

In section ( 12.31) we will show a model of innovation networks that produces "small- worlds" which 
combine the two properties of a high clustering coefficient and a small average path length. 

In the following sections we will describe some basic models of economic network theory, where 
we shall use the definitions and notations introduced above. 
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2.2 The Connections Model 



The connections model introduced by Ijackson and WolinskyI |l996l ) is of specific interest since 



it allows us to compute equilibrium networks analytically. The succeeding models can then be 
considered as extension of the connections model. Since these models are more complicated 
than the basic connections model they can, to a large extent, only by studied via computer 
simulationj^. Nevertheless they are of interest because they show a wider range of possible 
network configurations and associated performance of the agents in the economy. 

In the following we discuss the (symmetric) connections model proposed by 

Jackson and Wolinsky (199^)0 In this model agents pass information to those to whom 



they are connected to. Through these links they also receive information from those agents 
that they are indirectly connected to, that is, trough the neighbors of their neighbors, their 
neighbors, and so on. 

The individual incentives to form or severe links determine the addition or deletion of links. 
Incentives are defined in terms of the utility of the agents which depends on the interactions 
among agents, i.e. the network. The utility functions assigns a payoff to every agent as a function 
of the network the agents are nested in. 

The utility, Ui{G), agent i receives from network G with n agents is a function Ui : {G E Qn} K 
with 

n 

n.(G) = ^<5'^- - (4) 
i=i iGiVi 

where dij is the number of links in the shortest path between agent i and agent j. dy = oo if 
there is no path between i and j. < 5 < 1 is a parameter that takes into account the decrease 
of the utility as the path between agent i and agent j increases. N{i) is the set of nodes in the 
neighborhood of agent i. In this model the network is undirected. 

A measure of the global performance of the network is introduced by its efficiency. The total 
utility of a network is defined by 

n 

U{G) = Y,MG) (5) 
1=1 

A network is considered efficient if it maximizes the total utility of the network U (G) among all 
possible networks, G{n) with n nodes. 

Definition 1 A network G is strongly efficient if U{G) = X^ILi ^«(^) — ^(^') ~ Sr=i'"*(^') 
for all G' G g{n) 



^^For the use of computer simulations in economics see Axelrod and Tesfatsion (200a) 

^'*For a good introduction and discussion of related works we recommend the lecture notes of Zenou 1 2006[ l. 
There one can find the proofs give n here and related material in more detail. For a general introduction to 
economic networks see also iJacksonI ( 200(h . 
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Under certain conditions no new links are accepted or old ones deleted. This leads to the term 
pairwise stability. 

Definition 2 A network G is pairwise stable if and only if 

1. for all Cij G E{G), Ui{G) > Ui{E\eij) and Uj{G) > Uj{E\eij) 

2. for all Cij ^ E{G), if Ui{G) < Ui{E U dj) then Ui{G) > Uj{E U Cj-,) 

In words, a network is pairwise stable if and only if (i) removing any link does not increase the 
utility of any agent, and (ii) adding a link between any two agents, either does not increase 
the utility of any of the two agents, or if it does increase one of the two agents' utility then it 
decreases the other agent's utility. 

The point here is that establishing a new link with an agent requires the consensus (i.e. a simul- 
taneous increase of utility) of both of them. The notion of pairwise stability can be distinguished 
from the one of Nash equilibriunJ^ which is appropriate when each agent can establish or remove 
unilaterally a connection with another agent. 

There exists a tension between stability and efficiency in the connections model. This will become 
clear, after we derive the following two propositions. 

Proposition 3 The unique strongly efficient network in the symmetric connections model is 

1. the complete graph Kn if c < 6 — 6'^ , 

2. a star encompassing everyone if6 — S'^<c<6 + ^^5^ 

3. the empty graph (no links) if S + ^^^5^ < c. 

Proof. 1. We assume that 6^ < 6 — c. Any pair of agents that is not directly connected can 
increase its utility (the net benefit for creating a link is 6 — c — 6^ > 0) and thus the total 
utility, by forming a link. Since every pair of agents has an incentive to form a link, we 
will end up in the complete graph Kn, where all possible links have been created and no 
additional links can be created any more. 

2. Consider a component of the graph G containing m agents, say G' . The number of links in 
the component G' is denoted by k, where /c > m — 1, otherwise the component would not 
be connected. E.g. a path containing all agents would have m — 1 links. The total utility of 
the direct links in the component is given by k{s5 — 2c). There are at most _ left 



Considering two agents playing a game (e.g. trading of knowledge) and each adopting a certain strategy. A 
Nash equilibrium is characterized by a set of strategies where each strategy is the optimal response to all the 
others. 
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® 

Figure 2: A star encompassing 4 agents. 

over links in the component, that are not created yet. The utihty of each of these left over 
links is at most 25^ (it has the highest utility if it is in the second order neighborhood). 
Therefor the total utility of the component is at most 

k2iS-c)+(^^^^^-k]26^ (6) 



Consider a star Ki^m~i with m agents. The star has m — 1 agents which are not in the 
center of the star. An example of a star with 4 agents is given in Fig. The utility of 
any direct link is 26 — 2c and of any indirect link (m — 2)<5^, since any agent is 2 links away 
from any other agent (except the center of the star). Thus the total utility of the star is 

(m- l)(2(5-2c) + (m- l)(m-2)(52 (7) 

V V 

direct connections indirect connections 

The difference in total utility of the (general) component and the star is just 2{k — {ra — 
1))((5 — c— (5^). This is at most 0, since k > m — l and c > 6 — 6'^, and less than if /c > m — 1. 
Thus, the value of the component can equal the value of the star only if A: = m — 1. Any 
graph with k = m — 1 edges, which is not a star, must have an indirect connection with a 
distance longer than 2, and getting a total utility less than 26'^. Therefore the total utility 
from indirect connections of the indirect links will be below (m — l)(m — 2)6^ (which is the 
total utility from indirect connections of the star). If c < S — 5^, then any component of a 
strongly efficient network must be a star. 



Similarly it can be shown (jjackson and Wolinskyl . Il996l ) that a single star of m + n agents 



has a higher total utility than two separate stars with m and n agents. Accordingly, if a 
strongly efficient network is non-empty, it must be a star. 

3. A star encompassing every agent has a positive value only if S + -^^(5^ > c. This is an 
upper bound for the total achievable utility of any component of the network. Thus, if 
5 + ^^^S"^ < c the empty graph is the unique strongly efficient network. 

Proposition 4 In the connections model in which the utility of each agent is given by we 
have 

1. A pairwise stable network has at most one (non-empty) component. 
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2. For c<5- 5"^, the unique pairwise stable network is the complete graph Kn- 

3. For 6 — 5^<c<6a star encompassing every agent is pairwise stable, but not necessarily 
the unique pairwise stable graph. 

4- For 6 < c, any pairwise stable network that is non-empty is such that each agent has at 
least two links (and thus is efficient). 

Proof. 1. Lets assume, for the sake of contradiction, that G is pairwise stable and has more 
than one non-empty component. Let u*-' denote the utihty of agent i having a Hnk with agent 
j. Then, u'^ = Ui{G + eij)-Ui{G) if ^ E{G) and u^^ = Ui{G) -Ui{G - aj) if Cij G E{G). 
We consider now Cij £ E{G). Then u*-^ > 0. Let eti belong to a different component. Since 
i is already in a component with j, but k is not, it follows that u^^ > u^^ > 0, because 
agent k will receive an additional utility of 6"^ from being indirectly connected to agent i. 
For similar reasons u^'' > u"^ > 0. This means that both agents in the separate component 
would have an incentive to form a link. This is a contradiction to the assumption of pairwise 
stability. 

2. The net change in utility from creating a link is (5 — 5^ — c. Before creating the link, the 
geodesic distance between agent i and agent j is at least 2. When they create a link, they 
gain 6 but they lose the previous utility from being indirectly connected by some path whose 
length is at least 2. So if a < 6 — 6^, the net gain from creating a link is always positive. 
Since any link creation is beneficial (increases the agents' utility), the only pairwise stable 
network is the complete graph, Kn- 

3. We assume that 6 — 5^ < c — 6 and show that the star is pairwise stable. The agent in the 
center of the star has a distance of 1 to all other agents and all other agents are separated 
by 2 links from each other. The center agent of the star cannot create a link, since she has 
already maximum degree. She has no incentive to delete a link either. If she deletes a link, 
the net gain is c — 5, since there is no path leading to the then disconnected agent. By 
assumption, 6 — 6^<c<6, a — 6<0 and the gain is negative, and the link will not be 
removed. We consider now an agent that is not the center of the star. She cannot create 
a link with the center, since they are both already connected. The net gain of creating a 
link to another agent is 6 — 6'^ — c, which is strictly negative by assumption. So she will not 
create a link either. The star is pairwise stable. 

The star encompasses all agents. Suppose an agent would not be connected to the star. If 
the center of the star would create a link to this agent, the net gain would be 5 — c > 
and the benefit of the non-star agent is again 6 — c > 0. So both will create the link. 

The star is not the unique pairwise stable network. We will show that for 4 agents, the 
cycle, C4 is also a pairwise stable network. Consider Fig. jS]) 
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Figure 3: A cycle of 4 agents (left) and the resulting graph (right) after the deletion of a link 
from agent 3 to agent 4. 

©-© ©-© 
©-© ©-© 

Figure 4: A cycle of 4 agents (left) and the resulting graph (right) after the creation of a link 
from agent 3 to agent 1. 

If agent 3 removes a link to agent 4, then her net gain is c — 5 — 5^. For the range of costs 
of (5 — (5^ < c < (5 — (5^ < (5, she will never do it. If agent 3 adds a link to agent 1, Fig. 
the net gain is 6 — 6^ < 0. Thus, for n = 4 and 6 — 6'^<c<6 — 6^, then there are at least 
two pairwise stable networks: the star and the cycle. 

4. For 6 < c the star is not a pairwise stable network because the agent in the center of the star 



would gain c — 5 from deleting a link. Moreover, it can be shown (jjackson and Wolinsky 



19961 ) that any connected agent has at least 2 links. 



One can see, from the two propositions described above, that a pairwise stable network is not 
necessarily efficient. For high cost, i.e. c > 6 there are non-empty pairwise stable networks but 
they are not efficient. 



We now come to the evolution of the network as described in iJackson and WattsI (120021 ). The 
network changes when agents create or delete a link. At every time step an agent is chosen at 
random and tries to establish a new link or delete an already existing one. If a link is added, 
then the two agents involved must both agree to its addition, with at least one of them strictly 
benefiting (in terms of a higher utility) of the new link. Similarly a deletion of a link can only be in 
a mutual agreement. This adding and deleting of links creates a sequence of networks. A sequence 
of networks created by age nts myopically adding and deleting links is called an improving patJ^ 



(jjackson and Wattd . l2002l ). 

There is a small probability, e, that a mistake occurs (trembling hand) and the link is deleted 
if present or added if absent, e goes to zero in the long run, limj^oo e(i) = 0. By introducing 



^^Each network in the sequence of network updates differs in one link from the previous one. An improving 
path is a finite set of networks Gi, Gk in which one agents is better off by deleting a link {Gk+i has one link 
less than Gk) or two agents are better off by adding a link {Gk+i has one link more than Gk)- 
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this decreasing error e in the agent's decisions, the evolution of the networ k becomes a Markov 
proce sJ^ with a unique hmiting stationary distribution of networks visited ( Jackson and Watts . 



2002 ). The following definition is important to describe the stochastic evolution of the network. 



Definition 5 A network is evolutionary stable if it is in the limiting stationary distribution of 
networks of the above mentioned Markov process. 

We ha ve already investigated the structure and stability of the star. Fig. ([2]), and the cycle. Fig. 



In I Jackson and Wattd (120021 ) it is shown that for the case of 4 agents, the evolutionary stable 
networks indeed are the stars and cycles. So the network of agents evolves into a quite simple 
equilibrium configuration. 

2.3 The Connections Model and Small- World Networks 



Carayol and Rouxl (|2005l . l2003l ) propose a model of innovation networks in which networks emerge 
that show the properties of a "small world'0. This model is an extension of the above described 
connections model, sec. (12. 2p . and it uses the same notion of pairwise stability and efhciencJ^. 

We now give a sketch of the model. Agents are localized on a cycle and benefit from knowledge 
flows from their direct and indirect neighbors. Knowledge transfer decays along paths longer than 
one link. This means that less knowledge is received, the longer the path between the not directly 
connected agents is. The transfer rate is controlled by an exogenous parameter, 6. Each agent 
has a probability to innovate, that is dependent on her amount of knowledge. The knowledge 
level of an agent is dependent on two factors, (i) the in-house innovative capabilities of the agent 
and (ii) the knowledge flows coming directly from the neighbors or indirectly (with a certain 
attenuation factor) from those agents that are connected to the neighbors. 

Agent i supports costs, Ci{t), for direct connections which are linearly increasing with geographic 
distance, that is the distance on the cycle on which they recede. Agent i's utility Ui at a time t 
is given by the following expression. 

u,(G(t))= ^^'^- -c (8) 

where dij is the geodesic distance between agent i and agent j. S £ (0, 1) is a knowledge decay 
parameter and 6'^'^ gives the payoffs resulting from the direct or indirect connection between 



^^A Markov process is a random process whose future states are determined by its present state and not on the 
past states, i.e. it is conditionally independent on the past states given the present state. 

^*A small- world network combines high clustering (high probability that your acquaintances are also ac- 
quaint ances to each other) wit h a short characteristic path length (small average distance between two 



nodes') ijWatts and Strogatj . llQQSl l. 

^^A network is pairwise stable if and only if (i) removing any link does not increase the utility of any agent, 
and (ii) adding a link between any two agents, either does not increase the utility of any of the two agents, or if it 
does increase one of the two agents' utility then it decreases the other agent's utility. It is efficient if it maximizes 
total utility. 
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agent i and agent j. d'^j describes the geographic distance between agent i and agent j, that 
is the distance on the cycle. This is the main difference in the assumptions compared to the 
connections model discussed in sec. (12.21). 



Agents are able to modify their connections. This is were the network becomes dynamic. Pairs of 
agents are randomly selected. If the selected two agents are directly connected they can jointly 
decide to maintain a link or unilaterally decide to sever the link. If they are not connected, they 
can jointly decide to form a link. The decision is guided by the selfishness of the agents, which 
means that they only accept links from which they get a higher utility. 

The stochastic process of adding links to the network can be seen as a Markov process where each 
state is the graph structure at a certain time step. The evolution of the system is a discrete time 
stochastic process with the state space of all possible graphs. A small random perturbation where 
the agents make mistakes in taking the optimal decision to form a link or not is introduced. Agents 
are making errors with a probability e(t). This error term decreases with time, limj^oo = 0. 

The introduction of e enables us to find long-run st ationarv distributions tha t are independent 



of initial conditions (the ergodicity of the system) (I Jackson and Wattsl . l2002l ). Simulations are 
used in order to find these stationary distributions. Agents are forming and severing links until 
the network reaches a pairwise stable configuration where the agents have no incentive to create 
or delete links any more. The set of stochastically stable networks selected in the long run is 
affected by the rate of knowledge transfer, 6. The authors find critical values of this parameter 
for which stable "small world" networks are dynamically selected. This is the main difference in 
the resulting equilibrium network structure to the connections model, in which simpler network 
configurations are obtained. 

2.4 Introducing Heterogeneous Knowledge 



Ricottillil (|2006l . l2005l ) studies the evolution of a network of agents that improve their technological 
capabilities through interaction while knowledge is heterogeneously distributed among agents. 
In addition to the sharing of knowledge, each agent is assumed to have an "in-house" innovative 
capability. Considerable effort is necessary for this "in-house" research and as research is not 
always successful, it is assumed to change stochastically. 

An agent i's innovation capability, Vi, is given by 

N 

Vi{t) = aijbij{t)Vj{t) + Q{t) (9) 
i=i 

with an economy consisting of n agents, aij =const. is the broadcasting capacity of agent j 
to agent i and an = since no agent can broadcast information to herself. The matrix A with 
elements aij indicates the total technological information broadcasting capability of this economy. 
The proximity matrix elements bij{t) are either or 1 according to whether agent j is identified 
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from agent i as an information supplier. This is the neighborhood of agent i. Ci(t) £ (0, 1) is the 
in-house capability of agent i. This is a stochastic variable. 

Each agent i assesses the value of knowledge of its neighbors (where bij / 0), which are the 
addends of the first term in ([9]). From this function the least contributing one, denoted by 7i(t), 
is selected. 

7i(t) = mmi<j<N{aijbij{t - l)Vj{t - 1)} (10) 

In a random replacement procedure (search routine) an agent selects either its neighbors and 
second neighbors (local, weak bounded rationality) or the entire economy excluding its first and 
second neighbors (global, strong bounded rationality). By doing so, agent i assigns a new member 
j to the set of information suppliers, setting bij from to 1. This selection is only accepted if 



Vi{t) >Vi{t- 1) 



in) 



The population of agents is classified according to the size of the set of other agents by which 
they are observed. Global paradigm setters are agents that are observed by almost all agents in 
the economy. Local paradigm setters are observed by almost all agents belonging to the same 
component. 

Simulations of the evolution of the network show that stable patterns emerge. When the 
knowledge-heterogeneity of the economy is not very high, global paradigm setters emerge. For 
high levels of heterogeneity the economy become s partitioned in two separate halves. In each 
homogeneous one, local paradigm setters emerge. iRicottillil (|2006l . l2005l ) shows that the highest 
technological capabilities are achieved neither with a local search routine in which only the sec- 
ond neighbors are included nor in global search routines that span the whole economy. Rather a 
combination of both improves the system's innovative efficiency the most. 



2.5 Emerging Cyclic Network Topologies 



When studying multi-sector trading economies and input-output systems iRosenblattI |l957l ) al- 
ready identified the importance of circular flows and "feed-back" input dependencies between 
industries (realized by subgraphs called "cyclic nets"). A sufficient condition for a strongly con- 
nected network (in which there exits a path from every agent to every other age nt and that has 
an irreducible adjacency matrix) is the existence of a cycle. Subsequent works (IMaxfieldl . 1 1994 : 
Baldrv and Ghosall . l2005l ) have further incorporated the condition s of strong connectedne ss and 
cycles for the existenc e for a competiti v e eco nomy. More recently, Kim and Wong (j2007l ) study 
a generalized model of Bala and Goyal (l20od ) and find that the equilibrium networks consist of 
cycles (so called "sub- wheel partitions"). 

In the following sections we will focus on some recent network models of knowledge transaction 
and innovation (the creation of new knowledge) in which cyclic interactions of agents emerge. 
In section [3] we will study a new model of evolving innovation networks. Similarly to the above 
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mentioned authors we find that the existence of equihbrium networks with a positive knowledge 
production depends critically on the existence of cycles in the network. 



2.5.1 Production Recipes and Artifacts 

In the following sections we will focus on network models of knowledge transaction and inno- 
vation, the creation of ne w knowledg e, in which cyclic interactions of agents emerge. We start 



by reviewing a model by iLand (|2005l ) in which agents try to produce and sell artifacts. These 
artifacts can be manufactured according to a production recipe. Such a recipe can either be found 
independently or through the sharing of knowledge with other agents, which in turn can lead to 
an innovation, that is the discovery of a new recipe. 

Let us denote with rj^ the fc*'* recipe of agent i. There is an external environment which consists 
of external agents (customers) and artifacts which are not produced in the model. At each time 
period t one agent i is randomly chosen. Then the following steps are taken: 



1. The agent tries to get the input required for each recipe r^fc. If it is in the agent's own 
stock then she can produce immediately. If it is not, she buys it from another agent and if 
it cannot be bought she moves to another recipe. 

2. The agent chooses a goal, i.e. the product she wants to produce (one that gives high sales). 
Therefore she has to find the right recipe for the goal. She produces the product if a 
successful recipe is found. This can be achieved in two ways. The agent either can try to 
innovate by herself or she can try to innovate together with another agent. 

3. The wealth of agent i at time i + 1, Wi(t), is calculated according to 

Nk Ni 

Wi{t + 1) = Wi{t) + ^nifc(t) - Wi{t)'^piiCii - \wi{t) (12) 

k=l 1=1 

where is the number of products sold, nik{t) is the number of units sold of product 
k belonging to agent pu is the number products produced with recipe ru and cu is the 
production cost. 

The last term —\wi{t) guarantees that the wealth of an agent that has not sold any products 
and does not have any active recipes vanishes. 

4. The recipes that could not be successfully used to produce products are canceled. 

5. The set of acquaintances of an agent is enlarged. This is possible when two or more agents, 
that have goals which are close in artifact space (i.e. they require similar inputs) cooperate 
to produce that artifact. 

6. With a certain probability dead agents are substituted. 
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The basic dynamics, absent innovation, is one of production and sales, where the supply of raw 
materials is external as well as final product demand. There are two main differences to most 
agent-based innovation models. First, here the agents try to develop new recipes in order to 
produce products with high sales, as opposed to many agent-based mod els where th e generation 
of novelty is driven by some stochastic process. Second, in simulations Lane (|2005l ) shows that 



the network of customers and suppliers often forms closed, self-sustaining cycles. 
2.5.2 An Autocatalytic Model with Hypercycles 



Padgett et al. (|2003l ): Padgett (|l996l ) introduces an autocatalytic model, based on a hvpercvclJ^ 



model. Here agents are represented as skills and these skills are combined in order to produce. 
Skills, like chemical reactions, are rules that transform products into other products. 

In the following we will give a short overview of the models. There are two main aspects in 
the dynamics interaction of the agents: The process of production and the process of learning. 
The process of production includes three entities: skills, products and agents. Skills transform 
products into other products. The skills are features of the agents. On a spatial grid the agents are 
arrayed with periodic boundaries. Each agent has eight possible neighbors. At each asynchronous 
iteration a random skill is chosen. An agent with that skill randomly chooses an input product. 
If this product fits to the skill then the product is transformed. The transformed product is 
passed randomly to the neighbors of the agent. If the trading partner has the necessary skill it 
transforms the product further and passes it on. If the agent doesn't have the compatible skill, 
the product is ejected into the output environment and a new input product is selected. 

One can look at the production process from a wider perspective. An input product comes from 
the environment, then passes through production chains of skills until it is passed back as output 
to the environment. These chains self-organize because of a feedback mechanism of the agents. 
This mechanism is learning through the trade of products. 

The process of learning is modelled as learning by doing. If a skill transforms a product and then 
passes it on to another transforming skill, then the skill is reproduced (learned). Whenever one 
skill is reproduced anywhere in the system then another one is deleted at random to keep the 
overall number of skills constant. The agents are able to learn new skills by doing and they can 
forget skills they didn't use for a certain period of time. This procedure of learning introduces a 
feedback mechanism. When an agent loses all its skills, then it is assumed to never recover. 

In Padgett et al. (|2003l ): Padgett (1996) the emergence of self-reinforcing hypercycle production 
chains is shown. In these hypercycles agents reproduce each other through continuous learning. 
Such cycles generate a positive growth effect on the reproduction of skills. Thus, even in a 



^°A hypercycle is a system which connects self-replicative units through a cycle linkage ijEigen and Schuster . 
I979I I. 



^^This agent based model is publicly available on the website http:/ /repast. sourceforge.net/examples/index. html 
under the application module hypercycle. 
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competitive environment the sharing of knowledge is crucial to the long-run performance of the 
system. 

3 A New Model of Evolving Innovation Networks 



3.1 Outline of the Modeling Framework 

In this section we study the evolution of networks of agents exchanging knowledg^^l in a novel 
framework. The network can evolve over time either, by an external selection mechanism that re- 
places the worst performing agent with a new one or, by a local mechanism, in which agents take 
decisions on forming or removing a link. In the latter case, we investigate different modalities 
of interaction between agents , namely bilateral interactions, representing R&D collaborations 
|Hagedoorn et all |2000|, l2006ll or informal k n owled ge trading |Von Hippell . 119871 ) , versus unilat- 
eral interactions (similar to iBala and Goyall ([20001) agents decide unilaterally whom to connect 
to), representing a generalization of informal knowledge trading. We further study the impact of 
varying costs for maintaining links and the impact of augmenting or diminishing effects on the 
value of knowledge with the number of users associated with different types of knowledge. Our 
model exhibits equilibrium networks and we compare their structure and performance. Similar 
to the models discussed in the last section we will show that cyclic patterns in the interactions 
between agents play an important role for the stability (permanence) and performance of the 
system. 

We study different assumptions on the behavior of agents. In most simple case, denoted by 
Extremal Dynamics, agents form links at random and, through an external market selection 
mechanism, the worst performing agent (this is where the denotation extremal stems from) is 
replaced with a new one. In this setting agents are completely passive and they are exposed to 
a least-fit selection mechanism. 

In a more realistic setting, called Utility Driven Dynamics, agents choose with whom to interact, 
but their behavior is still boundedly rational and does not consider strategic interaction. The 
way in which agents create or delete links to other agents is a trial and error process for finding 
the right partner. Here we study two different modes of interaction. In the first interaction 
mode, agents are creating bilateral lin ks. Bilateral links represent form al RfcD collaborat ions 
among agents ([Hagedoorn et al\ . l2000l ) , or informal knowledge trading (I Von Hippell . 119871 ) . In 
the second interaction mode, agents are transferring knowledge unilaterally, which means that 
one agent may transfer her knowledge to another but the reverse is not mandatory. In this setting, 
the transfer of knowledge may be reciprocated, but knowledge can also be returned from a third 
party. In the latter case, we speak of indirect reciprocity. If knowledge is transferred unilaterally, 



^^See also t he ch apter of Robin Cowan and Nicolas Jonard in this book as well as Cowan and Jonar"dl (2004); 
Cowan et ai\ \20oi ). 
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the innovation network can be represented as a directed graph comprising unilateral links, while 
if all interactions are bilateral, the innovation network can be represented as an undirected graph. 

In the setting of unilateral links we also investigate the impact of additional benefits from network 
externalities. These benefits consider specific structural properties of networks which have an 
augmenting effect on the value of knowledge. We study two different types of network properties 
which increase the value of knowledge. We call these types Positive Network Externalities. The 
first Positive Network Externality considers the factor that, the more the centrality of an agent 
rises with the creation of a link, the higher is the benefit from that link. A high centrality indicates 
that an agent is connected to other agents through short paths. This means that, when knowledge 
travels along short distances between agents, it has a higher value than knowledge that has to 
be passed on between many agents. This effect can be captured by introducing an attenuation 
of knowledge with the distance it has to travel (by getting passed on from one agent to the 
next) until reaching an agent. The second Positive Network Externality captures an opposite 
effect when knowledge is passed on from one agent to the next. Here the value of knowledge 
increases with the number of transmitters (who are also user) of that knowledge. More precisely, 
we assume that feedback loops create an increase in the value of knowledge of the agents that 
are part of the loop. The more agents absorb and pass on knowledge the higher is the value of 
that knowledge. This means that a link that is part of a long feedback loop increases the value 
of the knowledge passed on from one agent to the nexj^. 

We can summarize the different settings that are studied in this section as follows. We investi- 
gate the performance and evolution under the two aforementioned assumptions on the behavior 
of agents, namely Extremal Dynamics and Utility Driven Dynamics. In the latter setting, we 
further study the effect of different modes of interaction, i.e. bilateral and unilateral knowledge 
transactions among agents. When studying unilateral interaction among agents, we introduce 
different augmenting processes on the value of knowledge depending on the structure of the net- 
work, called Positive Network Externality. We study the impact of an attenuation of the value 
of knowledge by the distance from the giver to the receiver as well as the contrary effect of an 
increase of the value of knowledge with the number of users of that knowledge depending on the 
type of knowledge under investigation. Finally, we discuss the networks obtained under these 
different settings with respect to their topologies and performance. 



3.1.1 Bilateral versus Unilateral Knowledge Exchange 



We interpret bilateral interactions as R&D collaborations on a formal or informal basis 
(jHagedoorn et a/.l . I200Q| ). Both parties involved share their knowledge in a reciprocal way, that 
means one agent is giving knowledge to another if and only if the other agent is doing this as 
well and both agents benefit from this transaction. 



We study closed loops, because we assume that knowledge issued from one agent has to return to that agent 
in order for her to take advantage of this added value of knowledge (created by the multiplicity of other users). 
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We then compare bilateral interaction with the case of agents sharing knowledge in a unidirec- 
tional way with other agents. They then maintain only those interactions that are in some form 
reciprocated (and this way lead to an increase in their knowledge levels after a certain time) 
but not necessarily from the agent they initially gave their knowledge to (indirect reciprocity). 
The latter is referred to unilateral knowledge exchange which can be seen as a generalization of 
informal knowledge trading. 

In the case of informal knowledge trading agents exchange knowledge if both strictly benefit. 
Instead, in the case of generalized informal knowledge trading, one agent transfers knowledge 
to another one without immediately getting something back. After a certain time (time horizon 
T) an agent evaluates its investment by assessing its total net increase in knowledge. By intro- 
ducing unilateral knowledge exchange we relax two requirements: (i) we do not require that the 
investment in sharing ones knowledge has to be reciprocated instantaneously and in a mutually 
concerted way. And (ii) the reciprocation does not necessarily have to come from the same agent. 
With this generalization we introduce that (i) agents have only limited information on the value 
of knowledge of others and on the network of interactions, (ii) Agents proceed in a trial and 
error fashion to find the right partners for exchanging their knowledge. In this setting reciprocity 
emerges either directly or indirectly. 

If the total knowledge level of an agent at the time horizon T is higher than it was when the 
agent started to share her knowledge with another agent, this interaction is evaluated beneficial, 
otherwise it is not. Only if the interaction is evaluated beneficial, the agent continues sharing 
its knowledge with the other agent, otherwise it stops the interaction. This procedure requires 
only limited information on the other agents, since the agent cares for its own total increase in 
knowledge and does not need to evaluate the individual knowledge levels of others. We describe 
this link formation mechanism in more detail in section (|4.3p . 



3.2 Unilateral Knowledge Exchange and Reciprocity 

If the interaction of agents are unilateral then agents invest into innovation by sharing knowl- 
edge with other agents. An investment is an advance payment with the expectation to earn 
future profits. When one agent transfers knowledge to another one without immediately getting 
something back, this can be regarded as an investment. There are usually two ways in which an 
investment can be expected to bring in reasonable returns. 

One way is the creation of contracts. As a precondition for contracts technologies must be pro- 
tectable (IPR). Otherwise agents can not trade them (once the technology is offered, i.e. made 
public, everybody can sim plv copv it and there is no mor e need to pay for it). Contracts must 



be binding and complete (IDickhaut and Rustichinil . I2OOII ). The contract has to be binding or 



agents may not meet their agreement after the payment has been made. It has to be complete, 
or uncertain agreements may lead agents to interpret it in a way most favorable to their position 
and this can cause agents to retreat from the contract. 
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The requirements for contracts can be difficult to realize. Another way is to expect reciprocative 
behavior to the investment. The beneficiary can either directly or indirectly reciprocate the 
benefit. Direct reciprocity means to respond in kind to the investor, and indirect reciprocity to 
reward someone else than the original investor. 

One of the possible e xplan a tions for reciproca l beh a yior ( Nowak and Sigmundl. 



Fehr and Fischbacher 



Dieckmann 



2003; 



Fehr and Schmidt 



1999; 



Bolton and Ockenfels. 



2005 



200 



1998 



(see e.g. 

2004 for a survey) is to assume the existence of reputation. Agents believe that 



if they invest into another agent they will increase their reputation and then realize a reasonable 
return coming back to them directly or indirectly ("strategic reputation building"). 

In reality, only partial information about reputation is available and experimental works show 
that, even in the absence of rep utation, there is a n on-n egligible amount of recip r ocal c oop- 
erative behavior among humans (jBolton et all l2005l ). As iDickhaut and Rustichinil (120011 ) put 
it, "...investment occurs even though agents cannot create binding contracts nor create reputa- 
tion." Thus, agents invest into each other by transferring their knowledge even if they cannot 
immediately evaluate the benefit from this investment. 

We assume that agents are not a priori reciprocating if they receive knowledge from others. But 
they perceive, that interactions that are reciprocated in some way are beneficial (increasing their 
own knowledge) and these are the interactions that they maintain in the long run. 

The problems associated with bilateral exchange of knowledge (direct reciprocity) and experi- 
mental evidence suggest that unilateral knowledge exchange, in which indirect reciprocity can 
emerge, is a relevant mode of interaction between agents. Moreover, the fact that interactions 
between anonymous partners become increasingly frequent in global markets and tend to replace 
the traditional long-lasting mutual business relationships poses a challenge to economic theory 
and is one of the reason for the growing interest about indirect reciprocity in the economic 
literature. 



3.2.1 Indirect Reciprocity, Directed Graphs and Cycles 

An R&D network can be described as a graph in which agents are represented by nodes, and 
their interactions by directed links. Indeed, as mentioned above, if agent i transfers knowledge 
to agent j (e.g. by providing a new technology), the reverse process, i.e. that agent j in turn 
transfers knowledge to i, is in principle not mandatory. This means that the links representing 
the transfer of knowledge are directed. The underlying graph can be represented by an adjacency 
matrix, A with elements aij G [0, 1], which is not symmetric, Uij / Uji. In other words, directed 
means that we distinguish the pairs (i,j) and representing the links from i to j and from 
j to i, respectively. On the other hand, if the adjacency matrix is symmetric, it means that any 
two agents are connected both by a link from i to j and by a link from j to i. We say, in this 
case, that they are connected by a bidirectional link. Notice that the symmetry also implies that 
the two links have identical weights. 
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Reciprocity requires the presence of cycles. In particular, direct reciprocity corresponds to a cycle 
of order k = 2, while indirect reciprocity corresponds to a cycle of order k >3 (see Fig. I3.2.1]) . 
Therefore, the emergence and permanence of direct /indirect reciprocity is deeply connected to 
the existence of cycles and in the graph of interactions. 




Figure 5: A cycle of length 2 represents an 
interaction between agents that is direct 
reciprocal. 



Figure 6: A cycle of length 3 (or longer) 
represents an interaction between agents 
that is indirect reciprocal. 



3.3 Formal Modeling Framework 

In this section, we formalize the general framework for the investigation of evolving networks of 
selfish agents engaged in knowledge production via the sharing of knowledge. In such a frame- 
work it is possible to investigate how the the emergence and permanence of different structures 
in the network is affected by (1) the form of the growth function of the value of knowledge, 
(2) the length of time horizon after which interactions are evaluated and (3) the link for- 
mation/deletion rules. At a first glance, this problem includes a multitude of dimensions, as 
the space of utility functions and link formation/deletion rules is infinite. However, some natural 
constraints limit considerably the number of possibilities and make a systematic study possible. 
In the following, we present the general framework. We then focus on a subset of the space of 
utility functions and link formation rules. For these, we present briefly some analytical results, 
but since the value of knowledge of an agent is assumed to be a nonlinear function of the neigh- 
boring agents, we illustrate them in terms of computer simulations. We finally summarize the 
results and discuss them in relation to the context of innovation. 

We consider a set of agents, N = {!,... represented as nodes of a network G, with an 
associated variable Xi representing the value of knowledge of agent i. The value of knowledge 
is measured in the units of profits an agent can make in a knowledge-intensive market. It has 
been shown that the growth of such knowledge-intensive ind ustries is highlv dependen t on the 



number and intensity of strategic alliances in R&D networks (jPowell and Grodall . l20Q6l ). In our 
model we bring the value of knowledge of an agent, denoted by Xj(t), at time t in relation with 
the values of knowledge of the other agents Xj (t) at time t in the economy, that are connected to 
the current agent i. A link from i to j, eij, takes into account that agent i transfers knowledge 
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to agent j. The idea is, that through interaction, agents transfer knowledge to each other which 
in turn increases their values of knowledge. 

We focus here only on the network effects on the value of knowledge of an agent. We therefore 
neglect the efforts of agents made to innovate on their own, without the interaction with otherJ^. 
In particular we assume that the growth of the value of knowledge of agent i depends only on 
the value of knowledge of the agents, j, with outgoing links pointing to him (those who transfer 
knowledge to her), j G V{G) such that Cji G E{G). 

In a recent studv on the dynamics of R&D collaboration networks in the US IT industry 



Hanaki et al\ (|20Q7l ) have shown t hat firms form RfcD collaborat ions in order to maximize their 



net knowledge (information) flow. ICassiman and Veugelerd (120021 ) suggested that this knowledge 



flow can be decomposed in incoming and outgoing spillovers capturing the positive and negative 
effects of R&D collaborations. 

We try to incorporate these positive and negative effects into a differential equation that de- 
scribes the change (increase or decrease) in the value of knowledge of an agent through R&D 
collaborations with other agents. We assume that the knowledge growth function can be decom- 
posed in a decay term a benefit term and a cost term depending on the interactions of an agent. 
The equation for knowledge growth reads 

dxi 



-D,{xi) + BiiA,x) - Ci{A,x) (13) 



where 



Xi growth of the value of knowledge of agent i 

A adjacency matrix (representing the network) 

X vector of agents' values of knowledge 

Di{xi) knowledge decay (obsolescence of knowledge) 

Sj(A,x) interaction benefits of agent i 

Cj(A,x) interaction costs of agent i 

B > and C > are benefit and cost terms, respectively, while D > is a decay term 
which includes the fact that a technology loses its value over time (obsolescence). In our setting, 
only through R&D collaborations with other agents, an agent can overcome the obsolescence of 
knowledge. This ensures that agents who do not interact with others have necessarily vanishing 
value of knowledge in our model (since Bi = Ci = Q ^ aij = Vj and thus Xj < 0). In other 
words we investigate an R&D intensive economy in which an agent's performance is critically 
depending on its R&D collaborations. 



^''The "il l-house" RfcD c apabilities of an agent could be introduced by an additional (stochastic) term Si{xi). 
Similar to Ricottillil I 2006l l in section l|2.5.ip Si{xi) captures the innovation activities of agent i without the 
interaction with other agents. We assume that the "in-house" capabilities of agents are negligible compared to 
network effects. Thus we concentrate only on network effects on the increase or decrease in the value of knowledge. 
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Interaction is described by the adjacency matrix A that contains the elements Uij in terms of 
and 1. This dynamics can be interpreted as a catalytic network of R&D interactions (passing a 
technology to another agent, R&D collaborations), where the different agents are represented by 
nodes, and their interaction by links between these nodes, cf. Fig. ([T]). More precisely, 

{1 if agents i transfers knowledge to agent j 
otherwise 

We noted already that the network of interactions is modeled on a directed graph, which means 
that the adjacency matrix is not generally symmetric: aij ^ aji. 

The benefit term, i?j(x, A), accounts for the fact that an agent's value of knowledge increases 
by receiving knowledge from other agents. The cost term, Cj(x, A), accounts for the fact that 
transferring knowledge to other agents is costly. Such a cost can vary in magnitude depending 
on the technological domain, but, in general, to make someone else proficient in whatever new 
technology requires a non-null effort. 

In the following we will further specify the growth of the value of in (fTSl) . We will make simple 
assumptions on benefits, i3j(x, A), and costs, Cj(x, A), which allow us to derive some analytical 
results and thus gain some insight on the behavior of the system. 

3.3.1 Pairwise Decomposition 

Networks are sets of pairwise relationships. In systems of interacting units in physics, a super- 
position principle holds, such that the force perceived by a unit is due to the sum of pairwise 
interactions with other units. Similarly, one could think of decomposing both benefits and costs 
of each agent i in a sum of terms related to the agents j interacting with i. However, this would 
imply to ignore network externalitiej^l (it is very important to note this fact). We will see in the 
following that externality does play an important role. So far the literature of Complex Networks 
have considered only the pairwise interaction term, while the literature on economic networks 
has focused on some simple externalities such as the network size, or the distance from other 
agents, see section (|2.5p . 

Our approach is to assume that benefit and cost are each decomposable in two terms: one term 
related to the direct interaction, further decomposable in pairwise terms, and another term 
related to externality (corresponding to positive and negative externality): 

Bi{A,x) = '^bji{xj,aji) + bji{xj,A) (15) 
j 

Ci{A,x) = '^Cij{xi,aij) + Cij{xi,A,x) (16) 
j 



In our model we define a network externality as a function of the network that affects the utility of an agent. 
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where b stands for benefit, c for cost, e for externality. The effect of network externahties will 
be explained in section (15. 3p . Benefit, b 
increasing with the value of knowledge, x 



, uji{xj,aji), and cost, Cij{xi,aij), terms are monotonically 



They have the the following properties 



bji (Xj , CLji) 





if aji 


= 0y Xj 


= 




if CLji 


= \ ^Xj 


> 


1" 


if aij 


= VXi 


= 


l>o 


if aij 


= 1 A Xj 


> 



(17) 



(18) 



We assume that benefits are linear functions of the value of knowledge of agent i which shares 
its knowledge with agent j. We the linear assumption bji{ 

In the most simple case costs for transf erring knowl edge can be neglected, Cij{xi,aij) = 0. This 



means that knowledge is fully codified |Forayl . 12004 ) and it can be transferred to another agent 
without any losses. Further, null costs imply that knowledge is non-rivalrous, meaning that the 
value of knowledge is not reduced by the use of that knowledge by another agent. When costs 
are neglected, the growth in the value of knowledge of agent i is given by the following equation 
(the case of Null Interaction Costs, further analyzed in section (13.5.1(1 ). 



dx 



= -dxi + b^ajiXj 



(19) 



In more realistic setting, costs cannot be neglected. In order to come up with a reasonable 
expression for these costs we make some further assumptions. We assume that the higher the 
value of knowledge of an agent is, the mo re complex it is . Moreover the more complex knowledge 
is, the more difficult is it to transfer it (ISorenson et a/.l . l2006l : iRivkinl . 120001 ) . The coordination 
and processing capabilities of agents are constrained ("managerial breakdown"). Thus, the more 
complex knowledge gets the higher are the costs for transferring it. The cost, Cij{xi, Uij), for 
transferring knowledge from agent i to agent j is an increasing function of the value of the 
knowledge that is to be transferred, Xj. We assume that costs increase by more than a proportional 
change in the value of knowledge that is being transferred. 

Cij{axi) > acij{xi) (20) 

This characteristic is closely related to decreasing returns to scale and convex cost functionJ^. 
The most simple setting for such a function is a quadratic term of the form (xj 
The growth in the value of knowledge of agent i is then governed by the following equation (the 
case of Increasing Interaction Costs, further analyzed in section (|3.5.2p ). 

dxi 
~dt 



-dx. 



(21) 



^^In the standard economic theory of the agent the extent to which a given input can increase output is usually 
assumed to be a decr easing function of the input. The output increases at a decreasing rate when the input in 



production increases ijHausman . I2OO3I I 
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This is an ordinary differential equation with a Hnear decay, a Hnear benefit and quadratic costs. 

(pTI) can be interpreted as an extension of a logistic equation. In a complete graph every agent 
shares her knowledge with every other agent. Starting with the same initial values this symmetry 
implies, that all knowledge values are identical, i.e. Xi = x. ([2T]l then becomes 



dx 
dt 



-dx + b{n — l)x — c{n — l)x'^ 



6(n — l)x (l 



(22) 



ix) 



([22]) is similar to the logistic function x = ax{l — ^) with parameters a = b{n — 1) and (5 = h/c. 

In the following section we relate the topology (cyclic topologies in particular) of the network 
with the long-run values of knowledge of the agents. 



3.4 Non-Permanence of Directed Acyclic Graphs 

The study of the relation between the performan ce of an economy and the underlying network of 
interactions ha s already a long tradition, see e.g. iRosenblattI (|l957l ) ("cyclic nets"). More recently 
Maxfieldl (119941 ) has shown that the existence of a competitive equilibrium is related to the strong 
connectedness of the network of relations between users and producers in a market economy. 
Strong connectedness means that there exists a closed walk or a cycle in the network. On the 
other hand, if there does not exist such a cycle, then the network is not strongly connected. In 
a similar way in our model strong connectedness is critically influencing the performance of the 
agents. In the main result of this section (fHl) we show that in our model all values of knowledge 
vanish if the underlying network of interactions does not contain a cycle. 

For the general equation (11311 we can identify the topology of the network in which agents cannot 
be permanent. iHofbauer and Sigmundl (|l998l ) give the following definition of permanence: 



Definition 6 A dynamical system is said to be permanent if there exists a 6 > such that 
Xi{0) > for i = I, implies lim^^oo inf Xi{t) > 6. 

First, we have to introduce the definition of graphs which do no contain any closed walks or 
cycles. 

Definition A directed acyclic graph is a directed graph with no directed cycles. 



More general, if a graph is a directed acyclic graph then it does not contain a closed walk. 

For sever al proo f s in t his section we need the following lemma (denoted by the comparison 
principle (IKhalill . Il995l )). 
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Lemma 7 If we consider two time- dependent variables, x{t) andy{t) with different growth func- 
tions g{x) and f{x) (continuous, differentiable) 

X = fix) (23) 
y = 9{x) (24) 
x{Q) = y(0) (25) 

and g{x) > f{x) then it follows that y{t) > x{t). Similarly if g{x) < f{x) then y{t) < x{t). 

Proof. Using Cauchy's mean value theorem for the two continuous, differentiable functions, 
x{t) and y{t), we have 

x'{t) ^ x{t) - xq ^ ^ 

y'{r) y{t) -yo~ 

with r G {0,t). The inequality holds since x'{t) = f{x{T)) > y'{T) = g{y{T)) Vr G (0,t). It 
follows that 

x{t) -xo> y{t) - 2/0 (27) 
Xq = yo (28) 

and thus x{t) > y{t). □ 

If a network is a directed acyclic graph then it does not contain a closed walk. For a directed 
acyclic graph we can make the following observation 

Proposition 8 In every directed acyclic graph, there is at least one node v with no incoming 
links, i.e. a source. 



Proof. (iGodsil and Royld . l200ll ) We give a proof by contradiction. We assume that every node 
has an incoming link. We start with some node u and find an incoming link (x, u) - by assumption 
every node has at least one incoming link. We go to the destination of the link, x. Again we can 
find an incoming link {y,x). We then proceed to node y. There is an incoming link {z,y). We 
consider node z. After at most n + 1 steps, we will visit some node in the graph twice. This is a 
contradiction to the assumption that the graph is acyclic. □ 

We can partition the nodes in the network into specific sets which take into account from which 
other nodes there exists an incoming path to these nodes. We will show that this is important 
to obtain a result on the permanence of the values of knowledge of the agents. 

Definition 9 We denote the set of sources of a directed acyclic graph G by Sq. We say that Sq 
is the 0-th order sources of G. The nodes that have only incoming links from are denoted by 
Si, the 1-st order sources of G. We consider the graph G\So. The nodes that have only incoming 
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links from Si in G\So (obtained by removing the nodes in Sq and their incident links from G) 
are denoted by 82- Accordingly, the nodes having only incoming links from Sk-i in the graph 
G\{Sk-2 U ... U So) are denoted by Sk, the k-th order sources of G, where k < n. 

We can have at most n such sets in the graph G with n nodes. In this case G is a directed path 
Pk- Moreover we have that 

Proposition 10 The nodes in a directed acyclic graph G can be partitioned in the sets 
Sq, Si, Sk, k < n defined in 

Proof. Prom proposition ^ we know that the directed acychc graph G has at least one source 
node. All the sources form the set Sq. If we remove the nodes in Sq (as well as their incident 
links) from G then we obtain again a directed acyclic graph Gi := G\So (since the removal of 
links cannot create cycles). Therefore proposition jS]) also holds for Gi. We consider the source 
nodes in Gi. These nodes have not been sources in G and they have become sources by removing 
the incident links of the sources in G. Thus, the source nodes in Gi have only incoming links 
from nodes in Sq. Further on, the sources in Gi form the set 5i. We can now remove the nodes 
5*1 from Gi and obtain the graph G2 with new sources ^2. We can consider the k — th removal 
of source nodes. We make the induction hypothesis that the sources of G^-i form the set S^-i- 
Removing the sources from G^-i gives a directed acyclic graph G^ which contains the sources 
Sk. One can continue this procedure until all nodes have been put into sets Sq, Si, Sk with at 
most k = n sets. □ 

There exists a relationship between the set (defined in (l9|)) a node belongs to and the nodes from 
which there exists an incoming path to that node. 

Corollary 11 Consider a node i G Sj. Then there does not exist a path from nodes k G Sm, 
m > j, to node i. Conversely node i has only incoming path from nodes in the sets Sq, Sj-i. 

Proof. Assume for contradiction that there exists such a path from a node k S Sm, m > j to a 
node i G Sj. By the construction of the sets Sj ([9|) node i must be a source with no incoming links 
after the removal of the sets Sq, ...,Sj-i from G. But this is a contradiction to the assumption 
that node j has an incoming link from a node k £ Sm, j- D 

From the above definition and observations we can derive an upper bound on the values of 
knowledge of the nodes in a directed acyclic graph. 

Proposition 12 Consider f7^) with a linear decay Di{xi) = dxi, a linear benefit Bi{A{G),x) = 
bJ2j^N~ ^'^'^ ^ non-negative cost Cj(A(G),x) > where d > 0, b > 0. Then for every node i 
in G there exists a k < n such that 

Xi{t) < {akt^ + ak-it^~^ + ... + ao)e-'^* (29) 
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Proof. Prom proposition (fTO]l we know the the directed acychc graph G has a partition of nodes 
into sources 5o, Sk, k < n. Consider a node xq G Sq. With (fT3]l the time evolution of her value 
of knowledge is given by 

Xq = —dxQ — Cq < —dxQ (30) 

Here we use the fact that Cq > 0. The function solving the equation x = —dx is an upper bound 
for Xo(t) (with identical initial conditions), see JT]). From proposition (fTTI) we know that there 
are first-order sources 5i in G that have only incoming links from nodes in Sq. The evolution of 
the value of knowledge for a node xi G Si is given by 

xi = —dxi + Xj — Ci (31) 

The second term on the right hand side of the above equation contains the sum of all values of 
knowledge of all nodes in Sq. We know that they are bounded from above by x{t) < x(0)e~'^*. 
Thus, ([3T]) has an upper bound 

xi < -dxi + aie"'^* (32) 

with an appropriate constant ai. The solution of the equation x = —dx + aie"'^* is given by 
x{t) = (ai + aot)e~'^*. It follows that 

xi < (ai + aoOe""'* (33) 

In the following we make a strong induction. We have the induction hypothesis that for the 
{k — l)-th order sources there exists an upper bound 

Xk-i < {ak-it'''^ + afc_2t^'^ + ... + ao)e-'^* (34) 

and this holds also for all nodes in the sets of sources with order less than k — 1. We consider 
the nodes in with I E Sk- We have that 

xi{t) = —dxi + b Xj — Ci (35) 

where the in-neighborhood Nf contains only nodes in the sets 5o, ...,Sk-i- For these nodes an 
upper bound is given by ([M]) and thus we get an upper bound for ([^Sl) 

xi{t) < -dxi + {ak-it''-^ + ak-2t^~'^ + ... + ao)e"'^* (36) 
We can now use the following lemma 

Lemma 13 For an ordinary differential equation of the form 

y + dy = {akt'' + ak-it''"^ + ... + 02* + ai)e~'^^ (37) 
there exists a solution of the form 

y{t) = (^-^t'+' + ... + aoy-'' (38) 

with the limit limj_^oo y{t) = 
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Solving for the upper bound from above gives the desired result. 

xi{t) < {akt'' + ak-it''-^ + ... + ao)e-'^* 



(39) 



□ 



With the last proposition (fT2]) it is straightforward to obtain the following corollary, which is the 
main result of this section. 

Corollary 14 Consider |T^) with a linear decay Di{xi) = dxi, a linear benefit i?j(A(G),x) = 



Cj and a non-negative cost Ci(A(G),x) > where d > 0, b > 0. If the network G is a 
directed acyclic graph then the values of knowledge vanish. This means that G is not permanent. 



Proof. Prom proposition (fT2]) we know that each node k in the graph G has a value of knowledge 
which is bounded by Xk{t) < {a^t^ + ak-it^~^ + ••• + ao)e~'^* for some finite k < n. Since any 
finite polynomial grows less than an exponential function we have that limt^oo Xk{t) = 0. This 
holds for all nodes in G. This completes the proof that for all i = 1, ...,n in a directed acyclic 
graph G we have that limt_*oo Xi{t) = and therefore G is not permanent. □ 

Thus, if agents are permanent, the graph contains a closed walk (or a cycle). If agents get 
their links attached at random, only those survive, who are part of a cycle. If agents can chose, 
whom to transfer their knowledge to, then th ey have to form cycles, in order to survive. Others 
(jBala and Goyall . 120001 : iKim and Wongl . 120071 ) have found similar results in which the equilibrium 
network consists of cycles. 

There exist a convenient way to identify if a network contains a cycle without actually looking at 
the permanence of the network which would require to compute the long-run values of knowledge 
(usually by numerical integration). Instead, from the eigenvalues of the adjacency matrix, A(G), 
of a graph, G, one can determine if G contains a cycle. The Perron-Probenius eigenvalue of a 
graph G, denoted by Apf(G) , is the largest real eigenvalue of A(G). The following properties 



hold (iGodsil and Rovlel . 12001 



Proposition 15 // a graph G 

1. has no closed walk, then Xpp{G) = 0, 

2. has a closed walk, then Xpp{G) > 1. 
Thus, if the graph contains p ermanent agents, then Apf(G') > 1- Stadler and Schuster (Il99d ) 



Hofbauer and Sigmund (|l998l ) have found similar conditions under which populations are per- 
manent in a network of replicatorJ^. 



^^The replicator equation (in continuous form) is given by: Xi = Xi (/i(x) — 0(x)) where ^(x) = J2i ^ifi{^) and 
/i(x) is the fitness of species i. 
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Finally, we can compute the probability of a network to contain a cycle if links were attached at 
random. 

Proposi tion 16 The probability of a random graph G{n,p) with n nodes containing a cycle is 
given by Uain and Krishna , \200m) 

P = {I - (I - pY-^Y (40) 

which is if p = and 1 if p = 1 . 

Proof. We can compute the probability of having a closed walk in a random graph G{n,p). 
Each link is created with probability p. Thus we have a Bernoulli process for the adjacency 
matrix elements Ojj (which indicate if an link exists or not). 



(41) 



{1 with probability p 
with probability 1 — p 

For every node we have n — 1 events to create an link and we are asking for the probability of 
having at least one of them being created (every n ode shou l d hav e at least one incora i ng lin k). 



This is a binomial cumulative function of the form |Durrettl . l2004l : ICasella and Bergeil . l200ll ) 

n-l , ^ 



k=l 



which is equivalent to eq. (HOI) , if we use the Binomial theorem 

i=i 



(43) 



□ 



A similar result to ([HI has been found by iKim and Wong) (120071). The author s study a gen- 
eralized version of the network formation model introduced by Bala and Goyal |200olr^ . The 
equilibrium networks in their model are so called "minimal" graphs which are graphs that max- 
imize the number of agents that are connected while maintaining only as few links as possible. 
It is intuitively clear, that the most sparse connected graph is a cycle. Thus, the authors find 
stable equilibrium networks that consist of cycles. However, in section [5?2] we will show that the 
network evolution can reduce the set of possible cycles in the equilibrium network such that only 
the smallest cycles survive. 

Thus, cycles play an important role in the evolution of the network and the ability of agents to 
have non- vanishing knowledge levels. Before we define the evolution of the network in section ^ 
we study the dynamics of the values of knowledge for a static network in the next section (13. 5p . 
There we will further specify the cost functions under investigation: null costs and nonlinear 
costs for maintaining links. 



^^For a fu r ther s tudy of Bala and Gova] I 2000l l applied to information networks see Haller and Sarangil l|2005[ l: 
Haller et ai\ l|2007ll. 
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3.5 Static Network Analysis 

In the following we analyze the growth functions for the value of knowledge and study two cases 
separately. In the first, costs are set to zero while in the second costs are a quadratic function of 
the values of knowledge of the agents. 



3.5.1 Null Interaction Costs 

The most simple case of our general framework is the one of linear benefit and null cost; 



i=l 



In vector notation (l44ll reads 



X 



(il)x 



(44) 



(45) 



where is the transposed of the adjacency matrix and I is the identity matrix. The solution 
of the set of equations (pSIl depends on the properties of the matrix A and has the general form 
(matrix exponential): 

(46) 



x(t) = e-"'*e^^*x(0) 



representing an exponential increase in time of the vector of knowledge values. The relative values 
of knowledge (shares) are given by 



(47) 



Rewriting ([^il) by means of ([TTII gives us the dynamics of the shares: 

n n 
3 k,3 



(48) 



(|48]1 has the property of preserving the normalization of y. No te that the decav term does not 
appear in this equat ion for the relative values. It can be shown (IHorn and Johnsonl . Il990l : iBoydl . 



20061 : iKrishnal . l2003l ) that the eigenvector to the largest real eigenvalue of (A respectively) 



This model has been studied by I Jain and Krishnal jl998bl ): iKrishnal l|2003l l to explain the origin of life from 
the perspective of interacting agents. The model of Jain and Krishna intends to describe the catalytic processes 
in a network of molecular species (which we will denote in the following by agents). However, it was very soon 
suggested to be applicable to an economic innovation context of interacting agents. In the next sections we will 
present a more general framework encompassing some of the limitation of the present one. In their model the 
X were interpreted as concentrations of chemical species. The aij are the kinetic coefficients that describe the 
replication of agents i resulting from binary interactions with other agents j. 
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is the stable fixed point of ([48]1^ . If we consider an eigenvector y^^^ associated with the largest 
real eigenvalue A of matrix (identical to the largest real eigenvalue of A) we have 



5]a,.yf = Ayf) (49) 



Inserting y^"^) into ([iSl) yields 



E-^^yr-yrE-^^vr (50) 

j k,j=l 



n 

k,j=l 

^ V ' 

= Ayf ) - Ayf) = (52) 



Thus, yf"^ is a stationary solution of (H8]l . For the proof of stability see e.g. iKrishnal (j2003l ) 



3.5.2 Increasing Interaction Costs 

In the following we study the evolution of the values of knowledge under a given network structure 
and we try to compute the fixed points where ever possible. We first show that the values of 
knowledge are non-negative and bounded. For graphs with 2 nodes, for regular graphs (including 
the complete graph), cycles and stars with an arbitrary number of nodes, we can compute the 
equililibrium points analytically. For generic graphs with n > 3 nodes we have to rely on numerical 
integrations. 

The nonlinear (quadratic) dynamical system is given by 

71 n 

Xi = —dxi + b o-jiXj — c aijxf (53) 
i=i i=i 

with initial conditions, Xj(0) > 0. aij are the elements of the adjacency matrix. A, of a graph G. 
This can be written as 

n 

Xi = —dxi + ^jj^i ~ cdfx^ (54) 

where df = Yl]=i '^ij the outdegree of node i. In the case of increasing costs we know that the 
values of knowledge are bounded. We have that 



^"if the largest real eigenvalue has multiplicity more than one then the sta ble fixe d point can be written as a 
linear combination of the associated eigenvector and generalized eigenvectors I Braunl . 1993l l. 
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Proposition 17 For the dynamical system I153\) the values of knowledge are non-negative and 
finite, i.e. < Xi < oo, i = 1, n. 

Proof. For the lower bound Xj > we observe that 

Xi > —dxi — c{n — l)xf (55) 

The lower bound is the solution of the equation x = —dx — c{n — \)x'^ . The solution of this 
equation can be found by solving the corresponding equation for the transformed variable z = ^. 

We get x{t) = ^dt_^^n-i)e'i^ with an appropriate constant a = ITI^Tjc- Starting from non- 
negative initial values a;(0) > this lower bound is non-negative as well and approaches null for 
large t, i.e. limt^oo x{t) = 0. We conclude that Xi(t) > 0. 

In order to compute an upper bound, Xj < const. < 00 we first make the following observation. 
The nodes of a graph, G = {V,E), can be partitioned in nodes without outgoing links, Vj C y 
("free-riders"), and nodes with at least one outgoing link, Vs '^V (sources). 

Since the "free-riders" in Vj have no outgoing links, the benefit terms of the sources in Vs are 
independent of the values of knowledge of the free-riders. Accordingly a source node i & Vg has 
the following knowledge dynamics. 

Xi = —dxi + b o-jiXj — cxfdf (56) 

where df is the out-degree of node i. We can give an upper bound of 

Xi < —dxi + h Xj — cxj (57) 

This upper bound has a (finite) fixed point and so does Xi{t). The fixed point is given by 

dxi + cxj = h Xj (58) 

This is a symmetric equation and therefore all Xi are identical, Xi = x. For contradiction assume 
that there would be Xi 7^ Xj. Then we have that 

dxi + cxj 7^ dxj + cx'j (59) 

But the left and right side of the equation are identical and so two different Xi,Xj cannot exist. 

When all solutions are identical we get Xi = x = ^^^^ Vi. Thus, we have shown that there exists 
an upper bound with a finite fixed point for the source nodes, that is Xi{t) < 00, i £ Vg. 
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We now consider the nodes with no outgoing Hnks ("free- riders") . A node i G Vf follows the 
dynamics 

Xi = —dxi + b CLjiXj (60) 

We have shown already that the source nodes are bounded by some constant, J2jeVs — const.. 
Thus we have that 

Xi < —dxi + const. (61) 

We have an upper bound of the Xj, i G V/-, given by 

/ N const. 
Xi{t) < xoe-'^' + (62) 

with limt^oo Xi{t) = . We have shown that for all nodes (sources Vs as well as "free-riders" 
Vf) 0<x^ <oo,i£ V{G). □ 

For special types of graphs we can deduce further results on the values of knowledge of the agents. 
First, we can compute the fixed points (given by Xj = 0) for regular graphs. 



Proposition 18 For any k— regular graph G the fixed point of the values of knowledge is given 

:b—c 
kc 



by X* = ^\ ■ In particular the complete graph Kn has the highest total value of knowledge among 



all regular graphs with x* = ^"^^^^'^ ■ 

Proof. The dynamics of the values of knowledge of the nodes in a regular graph with degree 
df = = k is given by 

Xi = —dxi + b Xj — ckxl (63) 

Starting with homogeneous initial conditions we make the Ansatz Xi = x i = 1, ...,n. We get the 
positive stable fixed points x* = n 

Second, we can compute the fixed points for cycles. 

Proposition 19 For any cycle Cn the fixed point of the values of knowledge is given by x* = 

Proof. The dynamics of the values of knowledge of a cycle Ck of length k is given by 

Xi = —dxi + bxi^i — ckxj (64) 

Starting with homogeneous conditions we make the Ansatz Xi = x i = l,...,n. We get the 
positive stable fixed points x* = □ 

Third, the fixed points for a star can be computed (the proof can be found in the appendix). 
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Proposition 20 For a star Kn^n-i there exists a fixed point which increases with the number of 
nodes. For d = the star has a fixed point of x* = ^. 

Proof. The dynamics of the values of knowledge of a star Ki^n-i is given by 

n 

xi = Xj — c(n — (65) 

i=2 

ixi)i>i = -dxi + bxi - cxj (66) 

where we assume that all links are bidirectional. Starting with homogeneous initial conditions 
we make the Ansatz Xj = X2 i = 2, ...,n. Then X2 is determined by the root of the polynomial 

3 2d , d{ch + {n-l)cd) b{d'-{n-m 
+ T^^^ + (n - l)c3 + _ 1)^3 - " i^^i 

And xi = fx2 + fxg. For d = we obtain = = ^. □ 



The fixed point increases with the benefit b and decreases with the decay d and the cost c. 

We observe that, for vanishing decay, d = 0, the fixed point of the system is identical for the 
regular graph, the cycle and the star and given by ^. As expected this fixed point is increasing 
with the benefit and decreasing with the cost. In a regular graph the fixed point is increasing with 
the degree k and the asymptotic value (for large A;) is ^. Thus, in a regular graph the fixed point 
ranges for increasing k from to ^. Similarly, for the star the fixed point also increases with 
the number of nodes (i.e. the degree of the central node) but we can not provide an analytical 
expression here. On the other hand, the fixed point of the cycle is independent of the length of 
the cycle. This means that there is no incentive for nodes to be part of larger cycles. And, as we 
will see in the next section, this limits the growth of the network. 



Example 21 We numerically integrate (E^ for n = 2 nodes. We set d = 0.5, c = 0.5 and 6 = 1. 

Fixed points are denoted x* for i = 1,2. x* = is a fixed point for all graphs. 



(1) 

0^=^(2) 



Ai 
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The fixed points are given by 



(2) 




The fixed points are given by 



(3) 
© 



© 



A. 




The fixed points are given by 



b-d 




0, i 




0, i = 1,2,3 



(6^ 



(69) 



(70) 



In general the fixed points of (I53p can only be computed numerically. As an example, we compute 
the fixed points for all graphs with n = 3 nodes for a specific choice of parameters. The results 
can be found in the appendix in section In our model we numerically integrate (f53]l for a 
large time T (and we find that in our simulations the system always reaches a stable fixed point). 



4 Dynamics of Network Evolution 

4.1 Network Evolution as an Iterative Process 

After providing the static equilibrium analysis, in this section we turn now to the dynamics of 
the network evolution by investigating different assumptions for the creation and deletion of 
links in the network. In particular, we compare two different scenarios, namely the so-called 
extremal dynamics, where agents do not decide themselves about the link creation and deletion. 
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and the utility driven dynamics, where agents make this decision themselves based on different 
rules discussed below. 

We first define the utility of the agents in our model for a given network G. 

Definition 22 Consider a (static) network G. The utility of agent i is given by 

\yi(T), for Null Interaction Costs 



Ui 



Xi{T), for Increasing Interaction Costs 



(71) 



where the value of knowledge Xi{t) is given by (53^ and A(G), the relative value of knowledge 
yi{t) by and A{G). T is called the time horizon. 



We assume that the accumulation of knowledge is faster than the frequency of the agents creating 
or deleting linkJ^. With this assumption, we can introduce a time-scale separation between the 
accumulation of knowledge and the evolution of the network. 



initialization 



Xi reach 
quasi-equilibrium 



perturbation 

of a, o- 



Figure 7: Schematic representation of the network evolution as an iterative process. 

The evolution of the system is then defined by an alternating sequence of knowledge accumula- 
tion, where we keep the network fixed for a given time T, A(G) =const., and changes in the links 
(asynchronous updating of the nodes) (see Fig.[7|. When the knowledge accumulation has reached 
time r, the network structure is changed. A change in the network takes place by either link 
addition between two agents i and j, aij = ^ aij = 1, or by link removal, aij = 1 ^ aij = 0. 
When the network has changed, the new utility, determined by ([22]) . can be computed for time 
2T. This iterative procedure of knowledge accumulation and link changes continues for 3T, 4r, ... 
and so on until the network reaches an equilibrium. One can schematically represent this iteration 
by the following algorithm: 

1 initialization: Random graph G{n,p). 



^^This means that the value of knowledge on the market (which is not explicitly modeled here) reaches a sta- 
tionary state determined by the R&D collaborations of each agent (and her neighbors). Only after this adaptation 
of the evaluation of the stocks of knowledge is finished, i.e. it has reached a stationary state, agents asynchronously 
change their links. 
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2 quasi-equilibrium: fast knowledge growth/decline 

With A fixed, agents evolve according to (fT3]) for a given (large) time T. 

3 perturbation: slow network evolution 

After time T, the network evolves according to two alternative selection processes: 



1. Extremal Dynamicrn. 

The agent with the minimum utility is chosen (if there are more than one agent with 
the same minimum value, then one of them is chosen at random). The utility of that 
agent is set to its initial value and all its outgoing and ingoing links are replaced with 
new random links drawn with probability p from and to all other agents in the system. 

2. Utility Driven Dynamics 

An agent is randomly chosen to create or delete one link (unidirectional or bidirectional 
link formation mechanisms, see section |43]) . More specifically: 

(i) Either a pair or a single agent is randomly chosen to create or remove a link. 

(ii) The effect of this link decision (creation or deletion) is evaluated at time T. The 
evaluation can have the following consequences on the link decision. 

* If the utility has increased, then sustain the link decision. 

* If the utility has decreased, then undo the link decision. 

4 Stop the evolution, if the network is stable (stability is defined in section (14. 3p . otherwise 
go to 2 

4.2 Extremal Dynamics versus Utility Driven Dynamics 

Extremal dynamics intends to mimic natural selection (the extinction of the weakest) and the 
introduction of novelty, which is a global selection mechanism. In contrast, utility driven dynamics 
is a local selection mechanism that mimics the process by which selfish agents improve their utility 
through a trial and error process. 

The decision upon to add or to remove a link implies a certain level of information processing 
capabilities (IPC) of the agents. IPC is usually bounded in a complex environment consisting of 
many other agents and a complex structure of interactions between these agents. In our approach 
we assume that the agents have no information on the knowledge values of the other agents and 
only limited information on their links (alliances). They only know with whom they interact 
directly (their neighborhood). In table (14.21) we give a short overview of levels of increasing IPC. 



See Bak and Sneppen (1993) 
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Least fit addition /removal of links, e.e Jain and Krishna fl998b) 


1 


Reactive (passive) acceptation/refusal of link changes. 


2 


Deliberate decision upon to add/remove a link based on a utility function 
deoendine on the network, e.e. Ebel and Bornholdt f2002l. without considering 
the possible decision of others. 


3 


Strategic interaction, e.e. Bala and Goval f2000l. considering the oossible 
actions of others. 



Table 2: Increasing levels of information processing capabilities (IPC) of agents. 



Extremal Dynamics refers to a situation in which agents are exposed to link changes they cannot 
influence and thus to level in table (|4.2p . Utility Driven Dynamics instead requires a higher 
level of IPC than a mere acceptation or refusal of link changes. But it requires less IPC than an 
approach assuming strategic interactions of agents. This follows from the fact that in our model, 
agents do not estimate how other agents could react on their decisions to change their links. This 
situation refers to level 2 in table (|4.2I) . In this chapter we compare two different settings, level 
and level 2. In the following paragraphs we describe them in more detail. 

Extremal Dynamics: At time T the agent with the smallest utility is removed from the 
system and replaced with a new one (market entry). The new agent is randomly connected 
to the already existing agents and a small initial value of knowledge is assigned to it. This 
process is a least fit replacement (extinction of the weakest) and the new agent introduces 
a kind of novelty in the system (innovation). 

2 Utility Driven Dynamics: The main difference between local link formation (Utility 
Driven Dynamics) compared to global link formation (Extremal Dynamics) is that agents 
are now individually taking decisions upon their interactions and they do that on the basis 
of a utility function (their values of knowledge at time T). Agents are bounded rational 
since they explore their possible interaction partners in a trial and error process. 

At every period, that is after time T, an agent is selected at random to create and delete 
links (asynchronous update). We distinguish two possible link formation mechanisms which 
we study separately, namely unilateral and bilateral link formation. In the former, unilateral 
link formation (i), the agent optimally deletes an old link and randomly creates a new link. 
Optimal means that either for creation or deletion of links the action is taken only if it 
increases the value of knowledge of the agent at time T in the range of all possible actions. In 
the latter, bilateral formation (ii), the selected agent optimally deletes a bilateral connection 
that she currently has or she randomly creates a new bilateral connection. Here optimal 
(in the range of all possible actions) means, that links are deleted if the initiator of the 
deletion, i.e. the selected agent, can increase its value of knowledge at time T with the 
deletion of the link, while for the bilateral creation both agents involved have to strictly 
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benefit from the creation of the mutual connectioro. In the following two sections we give 
a description of mechanisms (i) and (ii). 

To compare the two levels, for Utility Driven Dynamics the evolution of the network follows from 
local, utility driven, actions, as opposed to Extremal Dynamics, where the evolution follows from 
a global stochastic process (least fit selection plus random link formation). To be more specific 
about the latter, the rules for the network evolution, i.e. the creation and deletion of links under 
Extremal Dynamics, are the following: 

Step 1 After a given time T the least fit agent, i.e., the one with 

the smallest Ui = y-iiT), is determined. This agent is re- 
moved from the network along with all its incoming and 
outgoing links. 

Step 2 A new agent is added to the network with some small ini- 
tial value of knowledge yo- The new agent will take the 
place of the old one (it gets the same label), and randomly 
links itself to the other nodes in the network with the same 
probability p. Each of the other nodes can in turn link 
itself to the newcomer node with a probability p. 

These rules for the network evolution are intended to capture two key features: natural selection, 
in this case, the extinction of the weakest; and the introduction of novelty. Both of these can be 
seen as lying at the heart of natural evolution. The particular form of selection used in this model 



has b een inspired by what Bak and Sneppen have called "extremal dynamics" (|Bak and Sneppen 



19931). 



4.3 Rules for Link Creation and Deletion Using Utility Driven Dynamics 

In this section we introduce the process of the formation and deletion of links by agents that 
maximize a local utility function (depending on the agent and its neighbors). After time T, long 
enough such that the system reaches a quasi-equilibrium in the values of knowledge, an agent is 
randomly chosen to create or delete a link, either unidirectional or bidirectional. 

4.3.1 Unilateral Link Formation 

If agents unilaterally delete or create links it is possible that the interactions they form create a 
feed back loop, i.e. a closed cycle of knowledge sharing agents, that involves more than 2 agents. 
This introduces the concept of indirect reciprocity (see section [3?2]l . Unilateral formation of links 



'This behavior is individually optimal and thus may also be called rational. 
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(we then have a directed network) is necessary for indirect reciprocity to emerge, since, if all 
interactions were bilateral they would be direct reciprocal by definition. We now describe the 
procedure of unilateral link creation and deletion. 

1. Random Unilateral Creation 

An agent creates a link to another one to which it is not already connected at random and 
evaluates the creation of the link by comparing the change in their values of knowledge before 
and after the creation. Only if the change is positive, the link is maintained, otherwise the agent 
does not create the link. In this way agents explore possible partners for sharing their knowledge 
in a trial and error procedure. 



Step 1 An agent i is selected at random. 

Step 2 Another agent j is selected at random which is not already 

an out-neighbor of i. 
Step 3 Agent i creates an outgoing link to agent j. 
Step 4 The new utility (for the old network plus the new link 



create 





Figure 8: Random unilateral creation. 



Step 



5 



Cij) of agent i is computed and compared with the utility 
before the creation. 

Only if agent i's utility strictly increases compared to her 
old utility, then the link is created. 



2. Optimal Unilateral Deletion 



An agent deletes one outgoing link if this increases her utility. 



Step 1 Agent i is selected at random s.t. it has at least one outgo- 
ing link. 



Step 2 Agent i deletes separately each of its outgoing links to its 
neighbors Vj G and records the change in her utility, 

Atij. Before a new link is deleted, the old one is recreated. 



Step 3 Agent i computes the maximum change Attj and if it is 
positive, deletes the referring link. This means that only 
one link is finally deleted. The deletion only takes place if 
the current agent strictly increases her utility. 
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To characterize the equihbrium networks under this hnk formation and deletion mechanism we 
introduce the following characterization of stabilitj0. 

Definition 23 A network is unilaterally stable if and only if (i) no agent can create a link to 
(strictly) increase her utility and (ii) no agent can remove a link to (strictly) increase her utility. 



4.3.2 Bilateral Link Formation 

If agents form links bilaterally then all interactions are direct reciprocal by definition. We describe 
the process of bilateral link creation and deletion in the following paragraphs. 

1. Random Bilateral Creation 

In this link creation process a pair of agents is selected at random and given the possibility to 
form a bilateral connection. 



Step 1 Two agents are uniformly selected at random such that 
they are not connected already. 

Step 2 Both agents create an outgoing link to each other and 
therewith create a 2-cycle. 

Step 3 The new utilities (for the old network plus the new 2-cycle) 
of both agents are computed and compared with the utili- 
ties before the creation. 

Step 4 Only if both agents strictly benefit in terms of their util- 
ities compared to their old utilities, then the bilateral 
connection is created. 



2. Optimal Bilateral Deletion 

An agent deletes one of its outgoing links to another agent from which the agent also has an 
incoming link if this deletion increases her utility. 



Compare this to the definition of bilateral stability l[24|l . 




Figure 9: Optimal unilateral deletion. 
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Figure 10: Random bilateral Creation. 
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Figure 11: Optimal bilateral deletion. 

Step 1 Agent i is selected at random such that it has at least one 
mutual link to another agent. 

Step 2 From all bilaterally connected neighbors agent i deletes 
separately each of its outgoing links to its neighbors (and 
so does each neighbor j to agent i). For each, the change in 
the utility, Auj is recorded. Before a new links are deleted, 
the old ones are recreated. 

Step 3 Agent i computes the maximum change Auj and, if it is 
positive, the referring bilateral connection is deleted. The 
deletion only takes place if agent i strictly increases her 
utility. 

In order to characterize the equilibrium outcomes of our simulations we will in t roduc e a charac- 



terization of network stability. This definition has been introduced by IJacksonI (|2003l ) 



Definition 24 A network G is pairwise stable if (i) removing any link does not increase the 
utility of any agent and (ii) adding a link between any two agents, either doesn't increase the 
utility of any of the two agents, or if it does increase one of the two agents' utility then it 
decreases the other agent's utility. 



4.4 The Role of the Time Horizon for Unilateral Link Formation 

So far we have assumed that the time horizon T (after which agents evaluate their decisions 
to create or delete links) is long enough such that the values of knowledge reach a stationary 
state and the utilities of the agents are given by the fixed points of the values of knowledge. In 
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this section we discuss the effect of a time horizon that is smaller than the time to convergence 
to the stationary state of the values of knowledge. For relate d works that incorporate a fin ite 
time horizon in the evalu ation of the actions of agents see e.g. iHuberman and Glancd (119941 ) or 
Lane and Maxfieldl (Il997l ). 

If we consider Utility Driven Dynamics, we will show that permanent networks with positive 
values of knowledge emerge if agents wait long enough in evaluating their decisions. This is a 
necessary condition. Otherwise networks are not able to emerge or, if a network with positive 
knowledge values is existing already, it gets destroyed over time (network breakdown) . This effect 
is important in the case of null as well as increasing costs. 

To illustrate this point, we consider a 5-cycle of agents and the deletion of one link in this cycle 
which creates a linear chain of 5 nodes. Fig. (fT2]l . The evolution of value of knowledge for null 
costs and for costs c = 0.5 can be seen in Fig. (fT^ . 





Figure 12: A 5-cycle and a linear chain of 5 nodes (obtained from the cycle be removing one 
link). 





Figure 13: Numerical integration of the value of knowledge for d = 0.5, b = 1.0, null cost 
c = 0.0 (left) and cost c = 0.5 (right): evolution of knowledge values for a linear chain of 5 
nodes (obtained from the C5 by removing an link). The agent that removes the link (black up- 
per curve) initially experiences an increase in the value of knowledge. After an initial increase 
she experiences a decline and at a certain time her value of knowledge reaches her initial value 
(i in the case of null cost and in the case of increasing cost) and then it further decreases. 
After a time long enough her value of knowledge vanishes completely. 



More formally we can give the following proposition. 
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Proposition 25 Consider the dynamical system h21\) . For a directed path of length k the value 
of knowledge of node k is larger than e fort < T(e), i.e. Xk{t < T(e)) > e while limt^oo Xk{t) = 0. 



Proof. Consider a directed path of length k. 



k-l) > k 







Figure 14: A directed path Pk of length k. 

For node 1 (the source has no incoming links) in ([2T]l we get 

xi{t) = —dxi — cx\ (72) 
By introducing the variable z = and solving for z one can find the solution for x\ 

with a constant a = ^ In ^^j^ and the limit lim^^oo xi{t) = 0. Accordingly for the A;-th node we 
have that 

Xk = -dxk + bxk-i - cxl (74) 
Since x^ > 0, from proposition (flTll . the following inequality holds 

Xk > -dxk - cxl (75) 

and 

with a proper constant a' = ^ In Equating with e{t) at t = r we get 

d 



^dt—da' g 



(77) 



which yields 

= !!i(ill±^ (78) 

Thus we have found an e(T) such that for t < r(e) Xk{t) > e. The limit limt^oo Xk{t) = follows 
directly from the fact that the directed path Pk is a directed acyclic graph and we can apply 
proposition (fT^ . □ 
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With proposition ([25]l one can readily infer the following. If an agent in a cycle of length 
k removes a link unilaterally then a path is created. If the time horizon after which the 
agent evaluates this link removal is smaller then r(e)) the agent's value of knowledge satisfies 
Xk{t < T(e)) > e (this gives the utility of the agent, see (f22]l ). From proposition (fT9]l we know 
that the value of knowledge of the agent in the cycle is given by Xfc(O) = Choosing r(e) such 
that e > gives Xk{t < T(e)) > Xfc(O) and the agent experiences an increase in her utility by 
removing the link. The agent removes the link in order to increase her utility. This destroys the 
cycle. The time horizon of the agent in this case is too short in order to anticipate the vanishing 
long-run values of knowledge of all the agents in the resulting path, limf^oo ^i^t) = 0. 

From this observation we conclude that if the time horizon is too short, then all cycles would get 
destroyed and no network would ever be able to emerge nor sustain, since only cyclic networks 
can be permanent. The free- riding behavior of agents leads to the breakdown of the economy. 

4.5 Simple Equilibrium Networks for Unilateral Link Formation 

In this section we identify the most simple equilibrium networks for Unilateral Link Forma- 
tion. There exists a multitude of other equilibrium networks which usually cannot be computed 
analytically and which depend on the parameter values for decay, benefit and cost. 

The most simple equilibrium network is the empty network. 
Proposition 26 The empty graph is unilaterally stable. 

Proof. In an empty graph all nodes have vanishing values of knowledge. Creating a link does 
not create a cycle (which would be the case however if links were formed bilaterally) and thus 
the empty graph plus a link is a directed acyclic graph with vanishing values of knowledge, see 
proposition ((HJ. The creation of a link does not increase the utility of an agent. Thus, the agents 
do not form any links. □ 

Moreover, if all agents form disconnected cycles then we have an equilibrium network. 

Proposition 27 The set of disconnected cycles {C^ , ...,C^} , and possibly isolated nodes is uni- 
laterally stable. 

Proof. We give a proof for two-cycles. The proof can easily be extended to cycles of any length. 
Consider the two cycles C2 and C| in Fig. (fTSl) . 

From proposition ([T9]l we know that the fixed points are given by Xi = i = 1, ...,4. In order 
to show that we have a unilaterally stable equilibrium we (i) first show that no link is created 
and in the following (ii) that no link is deleted. 
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Figure 15: Two cycles and and the cases of link creation (i) and deletion (ii). 
(i) If a link is created (w.l.o.g.) from node 2 to 4 we get from (f^ 



xi = -dxi + bx2 - cxf = 



X2 = —dxi + hxi — cxn = 



Prom the first order conditions for the fixed points we get for node 1 



. - ^ ,80, 



And inserting this into the fixed point of node 2 gives 



62 - ^2 + - 86c3d - 262(i2 + ^4 
= A^d 

If the last inequality is fulfilled, then the creation of the link would decrease the utility of 
agent 2. The inequality holds if c" > which is certainly true for 6 > d and c > 0. 

Thus, no link is created between the cycles. 

(ii) If an link is deleted in a C2 then the we get vanishing steady state values of knowledge. 
Since > this would reduce the utility of the agent. Therefore the link is not removed. 

If there are k < [^J 2-cycles in G the the above argument holds for any pair of cycles. Similarly 
no isolated node can create a link in order to increase her utility nor can a node in a cycle create 
a link to an isolated node. Neither link creation nor removal increases the utility of the initiating 
agent and so the set of two-cycles is unilaterally stable. □ 

We further conjecture that a set of disconnected autocatalytic sets, where an autocatalytic set is 



defin ed as a set of nodes each having an incoming link from a node of that set (jjain and Krishna 



2001 



, stays disconnected under unilateral link formation. Thus, the size (in terms of nodes) is 



stable. 

With ([27ll we know that a cycle is unilaterally stable. In section (|4.4|) however we have shown 
that this result is critically depending on the time horizon T after which the action of an agent 
is evaluated (and it is true for cycles of any length only if T ^ 00). 
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For parameters values d = 0.5, b = 0.5 and c = 0.1 also the complete graph with three nodes 
K3 and the path P3 is unilateral stable. We observe this in simulations in Fig. (f22l) . However, by 
computing the fixed points numerically for d = 0.5, b = 0.5 and c = 0.1 in section jA]) one can 
see that K3 is no longer unilaterally stable (because removing a link increases the utility of an 
agent). 

In the next section we investigate if the dynamic processes of link formation and deletion lead 
to the simple equilibrium structures suggested above (and indeed we show that they are not 
obtained). 

5 Simulation Studies Using Different Growth Functions 

In the remainder of this chapter, we study simulations with different growth functions (for the 
value of knowledge) and different link formation mechanisms. We assume that the time horizon T 
is long enough such that the values of knowledge reach their stationary state. The dynamics of the 
value of knowledge is given by (fT9]l with null costs or by (pTI) with increasing costs. The different 
link formation mechanisms are described in section (|4.2p . We compare the equilibrium networks 
obtained from different costs and link formation rules in terms of their structure and performance. 
Finally, we study the effect of different positive network externalities on the equilibrium networks. 

Table ([3|) gives an overview of the simulations that we study in the following. We set d = 0.5, 
b = 0.5 and c = 0.1. The complete set of parameter values used throughout this section can be 
found in table dS]) in the appendix. 



5.1 Null Interaction Costs 



In the following we briefly discuss the evolution of the networ k with least fit link fo r matio n 
and null link cos t s. Thi s model has been studied in detail by Seufert and Schweitzer (|2007l ); 
Jain and Krishna (|200ol ). Later Saurabh and Cowan (2004) have applied it to an innovation 
model where new ideas are created and destroyed in a network of ideas. 

In this model agents do not have to pay costs for maintaining interactions. Accordingly, the 
dynamics on the values of knowledge is given by (fTOl) 

^ = -dxi + b^ajiXj 
and the dynamics in the shares of the values of knowledge yi = Xi/Y^^=i given by ([481) . 



E 



Vi ^ ajkVj 

k,3 
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Knowledge dynamics 


Network dynamics 


Section 


Null costs, Cij = 0: 


least fit replacement 


m 


^ = —dxi + b Ylj=i ^ji^j 






Quadratic cost, Cij oc xf: 

~dt ~ + l^j=l ^ji^j ~ C l^j=l ^ij^i 


least fit replacement 
unilateral link formation 
bilateral link formation 




Quadratic cost, ctj tx xf, and 
externality, Wjf. 


unilateral link formation 




^ = -dXi + YTj=l{bo.ji + beWji)Xj - cYTj=l (^ij^i 







Table 3: Overview of the simulation studies in this section with different knowledge growth 
functions and different link formation mechanisms. 



The utility is given by Ui = yi{T). We have described in section (|3.5.ip that the fixed point 
(stationary solution) of the relative values of knowledge in ([48]l exists and is given by the eigen- 
vector to the largest real eigenvalue of the adjacency matrix. We assume that the time horizon T 
(after which links get created or deleted) is large enough such that the system has reached this 
stationary state before links are changed. 



5.1.1 Extremal Dynamics: least fit replacement 



After time T the worst performing agent (in terms of her share of value of knowledge yi{T)) 
is rep laced with a new one. We hav e described this global link forma tion mechanism in section 
(|4.2p . Seufert and Schweitzer ( 2007 ): Jain and Krishna (j200ol . 1998a ) have extensively studied 
the behavior of the dynamics on y and the network G represented by A(G). They show that 
strongly connected sets of nodes with free-riders (that are receiving knowledge from the strong 
component but are not contributing knowledge back to the strong component) attachecJ^ appear 
and get destroyed in a process of repeatedly removing the worst performing node (with minimum 
Ui) and replacing it with a new one. 

In computer sirnulatio ns we can reproduce the results of Seufert and Schweitzer (l2007l ): 
Jain and Krishnal (|200Q| ). We observe crashes and recoveries in the average utility and degrees 
of the agents over time as can be seen in Fig. (fT6]l . Thus, no stable equilibrium network can be 
realized with this type of network dynamics. 



Jain and Krishnal l|200lh denote this set of nodes the autocatalytic set (ACS): it is a subgraph of nodes in 



which every node has at least one incoming link from that subgraph. 
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Figure 16: Least Fit replacement: (a) Average utility, (b) Average degree, (c) Initial random 
graph, (d) Graph after 5000 iterations. 



In the model of I Jain and Krishnal (|200Q| ) links are costless. In the next section (15. 2|) we assume 
that links have a cost attached that is an increasing function of the value of knowledge that is 
being transfered (section (15. 2j) ). 

Moreover, The least fit network dynamics treats agents as completely passive units that are 
exposed to an external selection mechanism. In a more realistic approach one should take into 
account that agents are deliberately deciding upon with whom to engage in an R&D collaboration 
or to share their knowledge with. These decisions are taken on the basis of increasing a utility 
function, that is their value of knowledg We introduce local link formation rules in section 
()4.3p . Moreover, as a further extension we study the effect of positive network externalities in 
section (15.31). 



^®A mo del in which the eigen vector associated with the largest real eigenvalue is used as a utility function is 
studied in Ballester et al. 1 20061 ). 
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5.2 Increasing Interaction Costs 

In this section we study the effect of increasing costs for maintaining interactions with other 
agents on the resulting equilibrium networks. The evolution of the value of knowledge is given 
by [53] and the utility of the agents by ([22]) . The cost of a link depends quadratically on the value 
of knowledge of the agent that initiates the interaction. We study three different link formation 
mechanisms. The first is a least fit replacement. We will compare the results of the simulation 
with the preceding section where links were costless. In the following two sections link formation 
mechanisms are studied in which agents decide locally upon to create or delete links either 
unilaterally or bilaterally based on their utility ([22]) . We assume that the time horizon is long 
enough such that the utility of the agents is given by the fixed points of the value of knowledge. 
We will show that least fit replacement of agents leads to a total network breakdown eventually 
from which the system cannot recover. Moreover, we show that bilateral link formation leads to 
a complete graph while with unilateral link formation this is not the case. For unilateral link 
formation only a small number of agents have non-vanishing knowledge values in the resulting 
equilibrium network and these cluster together in bilateral connections. Depending on the link 
formation mechanism and the parameter values (for decay, benefit and cost) the equilibrium 
networks can vary considerably. 

The evolution of the value of knowledge of agent i ([53]l 

J n n 

and her utility is given by Ui = Xi{T). 

5.2.1 Extremal Dynamics: least fit replacement 

Similarly to the preceding section links are formed and removed by a least-fit selection mechanism 
(introduced in section (14. 2|) ). The agent with the smallest utility ([22]l is replaced with a new agent. 
But in this section costs for maintaining links are an increasing function of the knowledge value 
of the transmitting agent. 

In this setting, it is possible that the system breaks down completely. A simulation run exhibiting 
such a crash can be seen in Fig. ([T7[) . If the network is sparse enough the link removal mechanism 
can destroy the cycles in the network and thus creates a directed acyclic graph. As soon as the 
network evolution hits a directed acyclic graph all value of knowledge vanish (and accordingly 
the utilities of the agents) and the network entirely breaks down. 

We do not experience a breakdown of the network in the case of null costs in the last section since 
there we were considering relative values of knowledge only. The normalization of the relative 
values, X]r=i Vi — ^ prevents all the shares to become at the same time. Hi = Vi. Thus we do 
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not get a total breakdown of the network in which all values of knowledge vanish. Instead, there 
the system can always recover from a crash of the network. 
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Figure 17: Extremal Dynamics: (a) Average utility, (b) Average degree, (c) Initial random 
graph, (d) Graph after 5000 iterations (in the equilibrium). The network experiences a total 
breakdown eventually. 



5.2.2 Utility Driven Dynamics: bilateral link formation 

In this section agents are creating or deleting links bilaterally. All interactions are therefore direct 
reciprocal. In simulations we observe the following effect. Bilateral creation and deletion results 
in a complete subgraph (The average degree is l/n^dj = 1/20 • 8 • 7 = 2.8, see Fig. [TS]) of 
the agents that were part of a permanent set in the initial graphic (the stability criterion which 
defines an equilibrium network is given in ([2T 



^'^the creation of the initial random graph with a given link creation probability has been chosen rather small 
such that only a few nodes are permanent. 
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C d 

Figure 18: Bilateral link formation: (a) Average value of knowledge, (b) Average degree, (c) 
Initial random graph (for reasons of visualization we have chosen a rather sparse random 
graph), (d) Graph after 1000 iterations (in the equilibrium). 



5.2.3 Utility Driven Dynamics: unilateral link formation 

The mechanisms of unilateral creation and deletion of links has been introduced in section (14. 3p . 
In our simulations we observe the following observe the following effect. When we allow for 
unilateral link formation, large cycles get reduced to a small set of 2-cycles. In the equilibrium 
network (the stability criterion which defines an equilibrium network is given in ([23]) ) most of the 
agents are isolated nodes and thus have vanishing values of knowledge. Only a few of them are 
organized in 2-cycles and small subgraphs consisting of multiple 2-cycles. As we will show, the 
reason for this is that as soon as there exists a shortcut (a smaller cycle) in a larger cycle agents 
try to free-ride and, after the other agents have realized that and sopped sharing their knowledge 
with them, they get isolated and experience vanishing values of knowledge. One can interpret 
this result as follows: Even though agents could in principal form indirect reciprocal interactions 
the resulting equilibrium network consists only of direct reciprocal interactions (2-cycles and 
clusters of 2-cycles). 
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Figure 19: Agent 3 forms a link to agent 1, 631, and thus a 2-cycle is created inside a 3-cycle. 



2.0 




Figure 20: Deletion of the link 621. Agent 2 is not sharing any knowledge with others but only 
receiving knowledge from agent 3. Thus, agent 2 is freeriding. 



We can give an example of the process of the reduction of cycles in a graph G with 3 nodes for 
parameter values d = 0.5, 6=1 and c S (0,1). By numerically comparing utilities (the fixed 
points of the value of knowledge) before and after a link is created or deleted we show that there 
exists a sequence of link deletions and creations which transform a 3-cycle into a 2-cycle while 
every link change is associated wit h an inc r ease i n the utility (the fixed point in the value of 
knowledge) of the initiating agent (Jackson (|2003l ) calls this sequence of graphs an "improving 



path"). 

In Fig. (fT9]l (left) agent 3 creates a link to agent 1 because in this range of parameters this 
increases her value of knowledge. This can be seen in Fig. (fT9]l (right), where the increase Ax^ 
different costs c € (0, 1) are plotted and Au^ = limt_^infty Ax^ > 0. 

In Fig. ([20]l (left) agent 2 removes her link to agent 1 and thus she stops contributing knowledge 
but instead is only receiving knowledge from agent 3. We say that agent 2 is free-riding. This 
increases her utility, since Au2 = linit^infty Ax2 > 0, as can be seen in Fig. ([20]) (right) for 
different costs c. 

Finally, in Fig. (pTl) (left) agent 3 removes her link to agent 2 because she is better off, as 
illustrated in Fig. (pTI) (right), when she stops contributing knowledge to an agent that is nothing 
contributing in return. This is actually true for agent 2. Agent 2 therefore gets isolated and 
experiences a vanishing value of knowledge in the long-run, lim^^^oo X2 = 0. Her utility is null. 
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Figure 21: Deletion of the link 632 by agent 3. Agent 3 realizes that she is better off by not 
sharing her knowledge with agent 2. Agent 2, that was free-riding before now gets isolated and 
experiences a vanishing value of knowledge in the long run. 



We end up in a setting where out of a cooperation of many (the sharing of knowledge) only a 
small set of cooperators remains and all the remaining agents vanish, i.e. have vanishing values 
of knowledge and utility. We can see this in a simulation starting from an initial random graph 
with 30 agents and the resulting equilibrium network in Fig. ([22]l (bottom right). 

Since the performance of the system in terms of the total value of knowledge is very low, we 
investigate in the next section the conditions under which the performance can be increased 
(with more agents being permanent in the equilibrium). We find that the existence of a positive 
network externality (explained in the next section) can enhance the performance of the system. 



5.3 Introducing Positive Network Externalities 

In this section we study the growth of the value of knowledge which includes an additional benefit 
term contributing to an increase in the value of knowled ge. Thi s addi t ional benefit depends o n 



the network structure itself. In the economic literature (|Tirold . Il988l : iMas-Colell et al\ . Il995l ) , 
"positive network externalities arise when a good is more valuable to a user the more users adopt 
the same good or compatible goods". In our model we define a network externality simply as a 
function of the network structure that affects the utility of an agent. Including the externality in 
the benefit can yield more complex structures with non vanishing knowledge values as equilibrium 
networks. The growth of the value of knowledge of agent i is given by the following equation: 

^ n n n 

= —dXi + b CLjiXj + be '^ji^j ~C ttijx] (82) 

i=l i=l i=l 

positive network externality 

and the utility is again given by Ui = limt^oo Xi{t). Link changes are based on the increase in 
utility. The network benefit incorporates the fact that the value of knowledge can change with 
the number of users of that knowledge, (f82]l . But the number of users can either enhance or 
diminish the value of knowledge that is being transferred between agents, depending on the type 
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Figure 22: Unilateral link formation: (a) Average utility, (b) Average degree, (c) Initial ran- 
dom graph, (d) Graph after 2000 iterations (in the equilibrium). For the parameter values 
d = 0.5, b = 0.5, c = 0.1, used in this simulation, the complete graph is an equilibrium. 
Note from section one can see that for parameter values d = 0.5, 6 = 1, c = 0.5 this is no 
longer the case and would be reduced to a 2-cycle C2. 

of knowledge under investigation. On one hand, the value can decrease with the number of agents 
that pass on that knowledge. Knowledge is attenuated with the distance from the creator to the 
receiver. We study this type of knowledge with a link weight defined in (f5^ and denoted by 
Wj^. In the next section we study the opposite effect: the value of knowledge increases with the 
number of users. This holds for example for general purpose technologies that get more valuable 
the more they are applied and used in different contexts (and users). The link weights used for 
this type of knowledge in (f82]l are denoted by w^^jWj^^, where the first measures the number of 
agents using that knowledge and the second the number of interactions. 

We introduce different link weights, denoted by if^j, u)^?^. Moreover, agents are creating 
and deleting links unilaterally (Utility Driven Dynamics). We then study the effect of different 
weights on the equilibrium networks obtained. 
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5.3.1 Centrality 

The growth function of the value of agent i is given by 

d ■ " ^ 

= -dxi + ^(6ajj + beW^ji)xj -c'^aijxj (83) 

i=i i=i 

The utihty is given by Ui = \\m.t-,ooXi{t) (large T). Link changes are accepted on the basis of 

an increase in utility. The centrality measure computes the sum of the inverse lengths of all 

the shortest paths containing the link for which the centrality is computed. If two agents are 

not connected then the length of the path is assumed to be infinity and thus its weight is zero. 

Instead, if two agents are directly connected via an link, then the weight is one. The weight values 

links that brings agents closer to each other higher. This is a similar approach to the Connections 

Model introduced in section [2^ with a utility given by dH). The centrality link weight, tu-^-, is 

then computed as follows. 

^?. = E7X^'^^.e[0,l] (84) 

v&V ^ + > 

djv is the shortest path between node j and node v. If there exists no path between two nodes, 
then the distance between them is infinitjEfl. 

In simulations. Fig. ([23I1 . we observe, that in the equilibrium network only a few agents have 
non-vanishing utilities (the asymptotic knowledge values) and most of them are isolated nodes 
with zero utilities. This result does not differ too much from the studies in section (|5.2p where no 
externality is considered. Apparently, if more agents should have non-vanishing utilities induced 
by an additional benefit depending on the network structure, this cannot be realized with the 
centrality link weight. 

5.3.2 Circuit-Centrality 

The circuit- centrality measure puts a weight on the links that depends on the number of distinct 
nodes that are contained in all the circuits going through the link under consideration. The 
motivation is that, if many agents are involved in the transfer of knowledge and this knowledge 
then comes back to the agent (thus creating a feedback on the techn ology issued by the agent), it 



gets an added value (e.g. for general purpose techn ologies (GPT) (jBresnahan and Trajtenberg 



19951 : iKarshenas and Stonemanl . ll995l : ICohenl . ll995l )) The more agents use a technology the more 



it is improved and so the more agents are involved in such a feedback loop the higher is the value of 
the technology. We can either count the number of different agents involved in this feedback loop 
or the number of interactions (links). Either possibility is explored in the next sections. This is an 



^*We use a standard depth-firs t-search algorithm to co r npute the shortest p a ths. More details on this algorithm 
and fu rther discussion is given in lSteger and Schickingerl ( 200l|) ; [Steger l|200lh : lAhuja et al\ l|l993l l:l ICormen et 
I 200lh 
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Figure 23: Centrality (|5.3.ip : (a) Average utility, (b) Average degree, (c) Initial random 
graph, (d) Graph after 500 iterations (in the equilibrium). 



altern ative way to study the emergence of indirect reciprocity where others iNowak and Sigmund 
(|20Q5l ) have studied it by introducing a (global) reputation mechanism. 

We then define the weight of an link Wij as (i) the number m„ of distinct nodes that are in the 
circuits from node i to j, 

'rri 

(85) 



rur, 



w, 



n 



<°e[o,i] 



and (ii) the number nie of distinct links that are in the circuits from node i to j, 



nip. 



w. 



w'^T G [0, 1] 



(86) 



n(n-l)' 

An example of the different link weights can be seen in Fig. (I5.3.2p . 

In order to compute all circuits in a directed graph G one needs to compute the trails in G. The 
closed trails then are the circuits in G. We use an algorithm to compute all trails in G from a 
given source node s. An explanation of the algorithm is given in appendix ([B]) . 
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Figure 24: The link ei2 is contained in two circuits with nodes 1,2,4 and 1,2,3,4. The num- 
ber of distinct nodes in these circuits is 4 and the number of distinct hnks is 5. Accordingly 
= I = 1 and = A = 0.42. 

By introducing the circuit-centrality externality, we will show that more agents are permanent in 
the equilibrium network. The performance of the system is increased compared to the equilibrium 
networks that emerge with unilateral link formation without this externality. 

Using circuit-centrality measures the number of nodes ((53]) and the growth of the value of knowl- 
edge is given by 

dx " ^ 

= -dxi + ^{baji + beWji'')xj - c^aijxf (87) 

The utility is given by Ui = limj^oo Xi{t) (large T). Link changes are accepted on the basis of an 
increase in utility. Different to the centrality externality (|5.3.1|) we observe larger cycles as the 
equilibrium networks. This can be seen in the simulation run in Fig. (I25p This positive externality 
allows for more agents to be permanent in the equilibrium network than without an externality 
or with the centrality-externality. We thus obtain a higher performance of the system. 

Using the circuit-centrality measure with the number of links ([861) the growth of the value of 
knowledge is given by: 

^ n n 

—1 = -dxi + '^{baji + hew'^f)xj -c'^aijxf (88) 
i=i i=i 

The utility is given by Ui = limt^oo Xi{t) (large T). Link changes are accepted on the basis 
of an increase in utility. The circuit centrality with the number of links values the number 
of interactions instead the number of agents, that take part in the transfer of knowledge. We 
still observe (fig. [26]l the emergence of circuits as equilibrium networks and a similar level of 
performance (in terms of the total value of knowledge of the system). But now there are more 
circuits (more links) in the subgraph containing the set of permanent agents. The equilibrium 
network has a higher level of redundancy (since its has more circuits and links) and is therefore 
more robust against the destruction of a single circuit (induced by a node or link failure). 
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Figure 25: Circuit number of nodes externality: (a) Average utility, (b) Average degree, (c) 
Initial random graph, (d) Graph after 500 iterations (in the equilibrium). 

6 Discussion and Conclusion 

6.1 Results From the Novel Modeling Approach 

In the following we summarize the results found by studying our model of innovation dynamics, as 
described in sections dH]), dl]) Jl]). Let us start by looking at the dynamics of the value of knowledge 
in a static network, in section (|3.5p . If we assume that growth occurs only through interaction 
among agents (thus neglecting "in-house" R&D capabilities), then the network sustains itself only 
through cycles (more precisely through closed walks or strongly connected components). Agents 
survive and grow only if they are part of a cycle (strongly connected component) or if they 
are connected to such a cycle through an incoming patlO- We have shown that an innovation 
network which is acyclic will have vanishing knowledge values for all agents in the network. 
However, if agents form cycles they have permanent knowledge values. 

Considering the evolution of the network we have studied two different settings. Extremal Dy- 
namics and Utility Driven Dynamics. If the network evolves according to a least fit selection 



Jain and Krishnal lj200ll l have denoted this set of nodes the autocatalytic set (ACS). 
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Figure 26: Circuit number of links externality: (a) Average utility, (b) Average degree, (c) 
Initial random graph, (d) Graph after 500 iterations (in the equilibrium). 

mechanism (Extremal Dynamics) then we observe crashes and recoveries of the knowledge val- 
ues of the agents and the network itself. Thus, an extremal market selection mechanism which 
replaces the worst performing agent with a new agent cannot generate equilibrium networks nor 
does it sustain a high performance in the value of knowledge of the individual agents or the econ- 
omy as a whole. Notice also that Extremal Dynamics means that agents are completely passive 
and have no control on whom they interact with. 

In a more realistic setting (Utility Driven Dynamics), agents decide with whom they interact and 
they do so in order to increase their utility. In the context of innovation this corresponds to their 
value of knowledge. The information processing capabilities of agents may be limited, especially 
if there is a large number of agents in the economy. Thus, we allow agents to decide themselves 
to create or delete links on a trial and error basis. Those interactions that prove to be beneficial 
are maintained while un-beneficial ones are severed. We find that, under these conditions, the 
evolution of the network depends on the cost, Cjj, of an interaction between the agents, the type 
of link formation (unilateral versus bilateral) and the time horizon T after which interactions are 
evaluated. 
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In the case of null cost, agents always form new links and thus the complete graph is eventually 
realized. 

We have shown in section (|3.4p that the knowledge values of agents van ish if the underly - 
ing netw o rk do es not contain a cycle (similar to the results obtaine d bv iRosenblattI (1957); 



Maxfieldl (119941) . The equilibrium networks are contain cycles similar to iBala and Goya" 



2nnm 



Kim and WongI (120071 )). However, the evolution of the network driven by the selfish linking pro- 
cess of agents can lead to the destruction of theses vital cycles. For a short time horizon T, and 
unilateral link formation, cycles get destroyed because agents free-ride and delete their outgoing 
links as it is beneficial in the short run to save the costs of supporting other agents. As a result, 
the whole innovation network is destroyed. On the other hand, if the time horizon is long enough, 
agents do not delete the cycles they are part of. 

However, even when the time horizon is long, large cycles get destroyed in favor of smaller ones 
when agents unilaterally form or delete links. The network, starting from an initial state of high 
density, evolves into an absorbing state in which most of the nodes are isolated and few pairs of 
nodes are connected by bilateral links. These pairs are trivial cycles of length k = j^ . 

Recall, that pairwise connections are direct reciprocal interactions. This means that, even though 
agents are unilaterally forming links and therefore indirect reciprocal interactions would be pos- 
sible in principle (this is equivalent to interaction taking place on a cycle of length > 3) no 
relation of indirect reciprocity is able to emerge nor to survive. Prom the point of view of the 
global performance of the innovation network, this is a very unsatisfactory situation. 

In section (15. 3p we have studied situations in which even unilateral knowledge exchange can 
have a higher performance in terms of the number of permanent agents and their total value of 
knowledge. We introduce an externality in the knowledge growth function which increases the 
value of knowledge of the agent depending on their position in the network. We study a type of 
technology where the value of knowledge decreases with the number of agents transferring the 
knowledge. Here unilateral knowledge exchange still leads to equilibrium networks with a low 
performance and only a few permanent agents. 

However, for a type of knowledge where its value increases with the number of agents that 
transfer and use it, more agents can be permanent in the equilibrium network and the system 
performance is increased. Moreover, if the number of interactions instead of the number of users 
determines the added value of the knowledge that is being transferred, then the equilibrium 
has not only a higher performance than in the setting, where knowledge is attenuated with the 
number of users or where no externalities are considered, but it is also more robust against node 
or connection failures. We observe that, in our framework, indirect reciprocity emerges if it is 
associated with a positive externality, taking into account the structure of the network. 



40 n 



This is different to the results obtained in lKim and Wong! lj2007l l since there the benefit term in the utility of 



the agents depends on the size of the connected component but not on its structure. 
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Netw. Evol. 
Cost Punc. — 


Extremal Dynamics 


Utility Driven Dynamics 


Bilateral 


Unilateral 


without 
externality 


with 
externality 


2 


network 
breakdown 




set of 
C2 


set of 

Cfc>2 



Table 4: Overview of the equilibrium networks that are realized under different assumptions on 
the network evolution and a quadratic cost function. 



If agents form or delete links bidirectionally, that means, every exchange of knowledge is direct 
reciprocal, the network evolves into a complete graph. This equilibrium network has a high per- 
formance and all agents are permanent. In our study we find that unilateral knowledge exchange 
is always inferior to bilateral knowledge exchange. But the above discussion has shown that, when 
bilateral knowledge exchange is not possible and agents are sharing their knowledge unilaterally, 
innovation networks are still able to emerge. 

The different cases studied in this section have shown that the equilibrium innovation network 
that is realized in the evolution of the system depends critically on the assumptions made on the 
behavior of agents (Extremal Dynamics versus Utility Driven Dynamics), on their time horizon 
for evaluating their decisions and on the cost associated with the sharing of knowledge. These 
results are summarized in table Jll 



6.2 General Conclusions 

In this chapter we studied a variety of different models for innovation networks. We started by 
discussing the importance of networks in economics and emphasized that these networks are 
intrinsically dynamic and composed of heterogeneous units. The notion of a complex network 
was used in the beginning to briefly explain how statistical physics can be involved to study 
them. We tried to classify different approaches to modeling economic networks, in particular we 
considered the connection between the state variables associated with the nodes of a network, 
e.g. the productivity level of a firm, and the dynamics of the network itself, i.e. the interactions 
between firms. 

Before developing our own modeling framework, we discussed some basic models of economic 
networks with agents engaged in knowledge production. These models show that the economy 
can evolve into equilibrium networks which are not necessarily efficient. Moreover, the equilibrium 
networks that emerge in these models are rather simple. We briefly introduced some models in 
which more complicated network structures emerge, which may be closer to real-world innovation 
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networks. We then discussed models in which cycles, i.e. closed feedback loop s, play an importa nt 



1953)). 



role in the network formation and the performance of the system (similar to [Rosenblatt 

The major part of the chapter was devoted to the development of our own modeling framework 
which is based on catalytic knowledge interactions. In this setting there are permanent agents 
(with non-vanishing knowledge values) only if the underlying network contains a cycle. We inves- 
tigated the evolution and performance of the system under different selection mechanisms, i.e., 
a least fit selection mechanism, denoted by Extremal Dynamics, versus Utility Driven Dynamics 
in which agents decide upon their interaction partners in a trial and error procedure. We ob- 
serve that a least fit mechanism cannot generate stable networks nor sustain high performance in 
knowledge production. Moreover such a mechanism assumes that agents are completely passive 
entities. In the case of Utility Driven Dynamics, agents choose their actions in order to increase 
their utility but their information processing capabilities are limited. If agents are evaluating 
their interactions after a time long enough, we obtain equilibrium networks with non-vanishing 
(permanent) knowledge production. 

In our framework, we investigated different assumptions about the behavior of agents, that is, we 
either assume that agents share knowledge bilaterally or unilaterally. If all interactions are bilat- 
eral, the equilibrium network is a complete graph and it has the highest performance. However, 
if direct reciprocal interactions cannot be enforced (which means that links are not necessarily 
bilateral), we still observe the emergence of networks of knowledge sharing agents. But in the 
equilibrium network only bilateral interactions remain. Moreover, only a few agents are perma- 
nent and the system has a low performance compared to the case of purely bilateral interactions. 
However, for unilateral interactions, the number of permanent agents can be significantly in- 
creased, for a type of technology where the number of users increases its value. 

Our studies show that the range of innovation networks that can emerge in this general framework 
is affected by various parameters. Amongst these are information processing capabilities of agents, 
their time horizon, their interactional behavior, the cost associated with the sharing of knowledge 
and the type of technology which agents produce and transfer. 

The variety of possible networks is quite large and the network model appropriate for a given 
application should be determined based on the specificities of the problem under investigation. 



Appendix 

A Stationary Solutions for G{n = 3) 

Example 28 We compute the fixed points for all graphs (auto-morphisms) with n = 3 nodes 
and initial values x(0) = (^, ^, ^)"^ = (^, ^, ^)^. For the numerical integration we set d = 0.5, 
c = 0.5 and 6=1. The fixed points (stationary solutions are denoted x* for i = l,2,3j. Where 



69/111 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



possible, we give the analytical solutions for the positive fixed points, x* = is a fixed point for 
all graphs. 
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B All- Trails-Single-Source Algorithm 

In this section we introduce an algorithm ALL-TRAILS-SINGLE-SOURCE that computes all 
trails from a given node s £ V to all other nodes in a directed graph G = {V,E). From these 
trails we can extract the trails which end in node s and thus form circuits. In the following we 
will give a short description of the algorithm. 

Algorithm 1 ALL-TRAILS-SINGLE-SQURCE 

S <— newStackO; 
u <— s; 

<— {}; {initialization of empty list of trails} 
loop 

if 3u G A^^"(t;)\{s} s.t. the link cannot be appended to W to create a new trail then 
S.push{v); 

W[u].addEdge{{v, u)); 
f <— u; 

else if S.isEmptyO == false then 

V <— s.popO; 
else 

break; 
end if 
end loop 
return W; 



Similar to a depth- first-search algorithm, links are explored out of the most recent discovered node 
V that still has unexplored links leaving it. This procedure of exploring links can be represented 
by a search tree T. The tree T explored by the algorithm contains all trails starting at the source 
s to every node in G. 

At every node i a list W[i] of trails leading from the source s to i is assigned. When the next 
link Bij from i to j is processed, to all trails in W[i] the link eij is appended (if this is possible, 
meaning that no link repetition is allowed), denoted by W[i] + eij. At node j these trails are 
added, that is W'[j] = W[j] U {W[i] + eij}. This procedure is continued until the algorithm 
terminates. The algorithm terminates, if the are no further links available for exploration. The 
progress of the algorithm on a directed graph with 4 nodes and 2 circuits containing the nodes 
(2,3,4,1) and (2,4,1), respectively, is shown in Fig. ([271) . 
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Figure 27: The progress of the algorithm ALL-TRAILS-SINGLE-SOURCE on a directed graph 
with node 2 as the source node. The node indicated in red is visited in the succeeding steps. 
After step 6 no further trails are added to the list of trails. 

C Simulation Parameters 

The parameters shown in table ([5]) have been used for the simulation runs presented in section 
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Description 


Variable 


Value 


initial link creation probability 


P 


0.1 


initial value of knowledge 


x(0) 


1.0 


number of agents (without externality) 


n 


30 


number of agents (with externality) 


n 


20 


max. numerical integration time (time horizon) 


T 


100 


numerical integration time step 


At 


0.05 


max. number of network updates 


N 


[100, 5000] 


benefit 


b 


0.5 


decay 


d 


0.5 


cost 


c 


0.1 



Table 5: Simulation parameters. 



writing the chapter we have always been conscious of our debt to colleagues who have helped 
us in bringing this work to the present state. Among these are in particular Kerstin Press and 
Mauro Napoletano who have pointed us to some inconsistencies and sections which needed a 
more extended explanation of the material treated there in the early versions of this chapter. 
The discussion with Dimo Brockhoff on the algorithms were of great help. We would like to thank 
the discussant and the critical audience at the 1st International Conference on Economic Sciences 
with Heterogeneous Interacting Agents in Bologna, 2006. Finally, we would like to thank Peter 
Howitt, Robert Axtell, Herbert Gintis and Leigh Tesfatsion for taking so much time in discussing 
the model at the 7th Trento Summer School on Agent-Based Computational Economics in Trento, 
2006 and Axel Leijonhufvud for making these discussions possible. 

References 

Aghion, P.; Howitt, P. (1998). Endogenous Growth Theory. MIT Press. 

Ahuja; Magnanti; Orlin (1993). Network flows: theory, algorithms, and applications. Prentice- 
Hall. 

Allen, R. C. (1983). Collective invention. Journal of Economic Behavior & Organization 4(1), 
1-24. 

Amaral, L.; Gopikrishnan, P.; Matia, K.; Plerou, V.; Stanley, H. (2001). Application of statistical 
physics methods and conceptsto the study of science & technology systems. Scientometrics 
51. 

Antonelli, C. (1996). Localized knowledge percolation processes and information networks. Jour- 
nal of Evolutionary Economics 6(3), 281-295. 

77/El 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



Arora, A.; Fosfuri, A.; Gambardella, A. (2004). Markets for Technology: The Economics of 
Innovation and Corporate Strategy. MIT Press. 

Arrow, K. J. (1962). The Rate and Direction of Inventive Activity, National Bureau of Economic 
Research, Princeton, chap. Economic Welfare and the Allocation of Resources for Innovation, 
pp. 609-625. 

Axelrod, R.; Tesfatsion, L. S. (2006). A Guide for Newcomers to Agent-Based Modeling in the 
Social Sciences. Staff General Research Papers 12515, Iowa State University, Department of 
Economics. 

Bak, P.; Sneppen, K. (1993). Punctuated Equilibrium and Criticality in a Simple Model of 
Evolution. Physical Review Letters 71(24), 4083-4086. 

Bala, v.; Goyal, S. (2000). A Noncooperative Model of Network Formation. Econometrica 68(5), 
1181-1230. 

Baldry, R.; Ghosal, S. (2005). Irreducible economies and strongly connected graphs. Journal of 
Mathematical Economics 41(8), 937-956. 

Ballester, C; Calvo-Armengol, A.; Zenou, Y. (2006). Who's Who in Networks. Wanted: The 
Key Player. Econometrica 74(5), 1403-1417. 

Barro, R. J.; Sala-i Martin, X. (2004). Economic Growth. MIT Press. 

Battiston, S. (2003). Dynamics and Evolution of Complex Networks in Socio-Economical Systems. 
Ph.D. thesis, Ecole Normale Superieure, Ecole Doctorale de Paris 7. 

Bollobas, B. (1985). Random Graphs. Cambridge University Press, 2nd edn. 

Bolton, G. E.; Katok, E.; Ockenfels, A. (2005). Cooperation among Strangers with Limited 
Information about Reputation. Journal of Public Economics 89, 1457-1468. 

Bolton, G. E.; Ockenfels, A. (2000). ERG: A Theory of Equity, Reciprocity, and Competition. 
The American Economic Review 90(1), 166-193. 

Boyd, S. (2006). Linear Dynamical Systems. Lecture Notes, Stanford University. 

Braun, M. (1993). Differential Equations and Their Applications. Texts in Applied Mathematics, 
Springer, 4th edn. 

Bresnahan, T. F.; Trajtenberg, M. (1995). General purpose technologies "Engines of growth"? 
Journal of Econometrics 65(1), 83-108. 

Carayol, N.; Roux, P. (2003). Self- Organizing Innovation Networks: When do Small Worlds 
Emerge? Working Papers of GRES - Cahiers du GRES 2003-8, Groupement de Recherches 
Economiques et Sociales. 



78/111 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



Carayol, N.; Roux, P. (2005). A Strategic Model of Complex Networks Formation. Tech. rep., 
Universite Louis Pasteur, Strasbourg and Universite Paris Sud. 

Casella, G.; Berger, R. L. (2001). Statistical Inference. Duxbury Press. 

Cassiman, B.; Veugelers, R. (2002). R&D Cooperation and Spillovers: Some Empirical Evidence 
from Belgium. The American Economic Review 92(4), 1169-1184. 

Cohen, W. (1995). Handbook of the Economics of Innovation and Technological Change, Blackwell 
Publishers Ltd., chap. Empirical Studies of Technological Activity, pp. 182-263. 

Cormen, T. H.; Leiserson, C. E.; Rivest, R. L.; Stein, C. (2001). Introduction to algorithms. MIT 
Press. 

Costa, L. F.; Rodrigues, F. A.; Travieso, G.; Boas, P. V. (2007). Characterization of complex 
networks: A survey of measurements. 

Cowan, R.; Jonard, N. (2004). Network structure and the diffusion of knowledge. Journal of 
Economic Dynamics and Control 28(8), 1557-1575. 

Cowan, R.; Jonard, N.; Ozman, M. (2004). Knowledge Dynamics in a Network Industry. Tech- 
nological Forecasting and Social Change 71(5), 469-484. 

Dickhaut, J.; Rustichini, A. (2001). Investment Game. Forthcoming in the Encyclopedia of 
Cognitive Sciences. 

Dieckmann, A. (2004). The Power of Reciprocity: Fairness, Reciprocity, and Stakes in Variants 
of the Dictator Game. Journal of Conflict Resolution 48(4), 487-505. 

Durlauf, S. N. (1999). How can statistical mechanics contribute to social science? Tech. rep., 
Wisconsin Madison - Social Systems. 

Durrett, R. A. (2004). Probability. Theory and Examples. Thomson Learning. 

Ebel, H.; Bornholdt, S. (2002). Evolutionary games and the emergence of complex networks. 
preprint cond-mat/0211666 . 

Eigen, M.; Schuster, P. (1979). The Hypercycle: A principle of natural self-organization. Springer, 
Berlin. 

Farmer, J. D.; Smith, E.; Shubik, M. (2005). Economics: The next physical science? 

Fehr, E.; Fischbacher, U. (2003). The Nature of Human Altruism. Nature 425, 785-791. 

Fehr, E.; Schmidt, K. M. (1999). A Theory of Fairness, Competition and Cooperation. The 
Quarterly Journal of Economics , 817-868. 



79/111 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



Foray, D. (2004). The Economics of Knowledge. MIT Press. 

Frenken, K. (2006). Technological innovation and complexity theory. Economics of Innovation 
and New Technology 15(2), 137-155. 

Gabszewicz, J. (2000). Strategic Interaction and Markets. Center for Operations Research and 
Econometrics (CORE), Catholic University of Louvain: Oxford University Press. 

Gallegati, M.; Kirman, A. P. (eds.) (1999). Beyond the Representative Agent. Edward Elgar 
Publishing. 

Gerosky, P. (1995). Handbook of the Economics of Innovation and Technological Change, Black- 
well Publishers Ltd., chap. Markets for Technology: Knowledge, Innovation and Appropriabil- 
ity. pp. 90-131. 

Gigerenzer, G.; Selten, R. (eds.) (2002). Bounded Rationality: The Adaptive Toolbox (Dahlem 
Workshop Reports). MIT Press. 

Godsil, C. D.; Royle, G. F. (2001). Algebraic Graph Theory. Springer. 

Goyal, S. (2007). Connections: an introduction to the economics of networks. Princeton University 
Press. Forthcoming. 

Gross, T.; Blasius, G. (2007). Adaptive Coevolutionary Networks - A Review. Eprint arXiv: 
0709.1858. 

Hagedoorn, J.; Cloodt, M.; Roijakkers, N. (2006). Patterns In Inter-Firm R&D Networks In The 
Global Computer Industry: A Historical Analysis Of Major Developments During The Period 
1970-1999. Paper presented at SPRU 40th Anniversary Conference - The Future of Science, 
Technology and Innovation Policy, SPRU, Brighton, East Sussex, United Kingdom. 

Hagedoorn, J.; Link, A. N.; Vonortas, N. S. (2000). Research partnerships. Research Policy 
29(4-5), 567-586. 

Haller, H.; Kamphorst, J.; Sarangi, S. (2007). (Non-) existence and scope of Nash networks. 
Economic Theory 31, 597-604. 

Haller, H.; Sarangi, S. (2005). Nash Networks with Heterogeneous Links. Mathematical Social 
Sciences 50, 181-201. 

Hanaki, N.; Nakajima, R.; Ogura, Y. (2007). The Dynamics of R&D Collaboration in the IT 
Industry. Working Paper. 

Hausman, D. M. (2003). Inexact and Separate Science of Economics. Cambridge University 
Press. 



80/111 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



Hofbauer, J.; Sigmund, K. (1998). Evolutionary Games and Population Dynamics. Cambridge 
University Press. 

Horn, R. A.; Johnson, C. R. (1990). Matrix Analysis. Cambridge University Press. 
Huberman, B.; Glance, N. (1994). Beliefs and cooperation. 

Jackson, M. (2007). Social and Economic Networks. Princeton University Press. Forthcoming. 

Jackson, M. O. (2003). A survey of models of network formation: Stability and efficiency. Working 
Papers 1161, California Institute of Technology, Division of the Humanities and Social Sciences. 

Jackson, M. O. (2006). Advances in Economics and Econometrics: Theory and Applications, 
Ninth World Congress, Cambridge University Press, vol. I, chap. The Economics of Social 
Networks, pp. 1-56. 

Jackson, M. O.; Watts, A. (2002). The Evolution of Social and Economic Networks. Journal of 
Economic Theory 106(2), 265-295. 

Jackson, M. O.; Wolinsky, A. (1996). A Strategic Model of Social and Economic Networks. 
Journal of Economic Theory 71(1), 44-74. 

Jain, S.; Krishna, S. (1998a). Autocatalytic Sets and the Growth of Complexity in an Evolu- 
tionary model. Physical Review Letters 81(25), 5684-5687. 

Jain, S.; Krishna, S. (1998b). Emergence and Growth of Complex Networks in Adaptive Systems. 
E-print adap-org/9810005. 

Jain, S.; Krishna, S. (2000). A model for the emergence of cooperation, interdependence and 
structure in evolving networks. 

Jain, S.; Krishna, S. (2001). A model for the emergence of cooperation, interdependence, and 
structure in evolving networks. Proceedings of the National Academy of Sciences 98(2), 543- 
547. 

Jain, S.; Krishna, S. (2002). Handbook of Graphs and Networks, John Wiley and VCH, chap. 
Graph Theory and the Evolution of Autocatalytic Networks, pp. 355-395. 

Karshenas, M.; Stoneman, P. (1995). Handbook of the Economics of Innovation and Technological 
Change, Blackwell Publishers Ltd., chap. Technological Diffusion, pp. 264-297. 

Khalil, K. H. (1995). Nonlinear Systems. Prentice Hall. 

Kim, C; Wong, K.-C. (2007). Network formation and stable equilibrium. Journal of Economic 
Theory 133, 536-549. 



Sl/El 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



Kirman, A. (1997). The economy as an evolving network. Journal of Evolutionary Economics 
7(4), 339-353. 

Konig, M. D.; Battiston, S.; Napoletano, M.; Schweitzer, F. (2007a). Efficiency and Stability of 
Dynamic Innovation Networks. Forthcoming. 

Konig, M. D.; Battiston, S.; Napoletano, M.; Schweitzer, F. (2007b). On Algebraic Graph Theory 
and the Dynamics of Innovation Networks. Networks and Heterogeneous Media, forthcoming. 

Krishna, S. (2003). Formation and Destruction of Autocatalytic Sets in an Evolving Network 
Model. Ph. D. Thesis, Centre for Theoretical Studies, Indian Institue of Science. E-print 
arxiv:nlin.AO/0403050 vl. 

Lane, D. (2005). A Theory Based Dynamical Model of Innovation Processes. Tech. rep., Depart- 
ment of Political Economy, University of Modena. 

Lane, D.; Maxfield, R. (1997). Foresight, Complexity and Strategy. 

Lerner, J.; Tirole, J. (2002). Some Simple Economics of Open Source. The Journal of Industrial 
Economics L(2). 

Mas-Colell, A.; Whinston, M. D.; R., G. J. (1995). Microeconomic theory. Oxford University 
Press New York. 

Maxfield, R. R. (1994). General Equilibrium and the Theory of Directed Graphs. Journal of 
Mathematical Economics 27, 23-51. 

Nelson, R. (1959). The Simple Economics of Basic Research. Journal of Political Economy 67, 
297-306. 

Newman, M. (2003). The Structure and Function of Complex Networks. SIAM review 45(2), 
167-256. 

Nowak, M.; Sigmund, K. (1998). Evolution of Indirect Reciprocity by Image Scoring. Nature 
393, 573-577. 

Nowak, M.; Sigmund, K. (2005). Evolution of Indirect Reciprocity. Nature 437, 1291-1298. 

OECD (2006). OECD Science, Technology and Industry Outlook 2006. OECD Pubhshing. 

Padgett, J. F. (1996). The Emergence of Simple Ecologies of Skill: A Hypercycle Approach to 
Economic Organization. Working Papers 96-08-053, Santa Fe Institute. 

Padgett, J. F.; Lee, D.; Collier, N. (2003). Economic production as chemistry. Ind Corp Change 
12(4), 843-877. 



82/111 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



Powell, W.; Grodal, S. (2006). Oxford Handbook of Innovation, Oxford University Press, USA, 
chap. Networks of Innovators, pp. 56-85. 

Ricottilli, M. (2005). Firms and Network Formation Through the Transmission of Heterogeneous 
Knowledge. Tech. rep., Department of Economics, University of Bologna. 

Ricottilli, M. (2006). Constraints and Freedom of Action: a fitness trade-off. Tech. rep.. Depart- 
ment of Economics, University of Bologna. 

Rivkin, J. W. (2000). Imitation of Complex Strategies. Management Science 46(6), 824-844. 

Rosenblatt, D. (1957). On Linear Models and the Graphs of Minkowski-Leontief Matrices. Econo- 
metrica . 

Saurabh, A.; Cowan, R. (2004). The Growth of Knowledge and Complexity in an Evolving Net- 
work Model of Technological Innovation. Tech. rep., UNU-INTECH and MERIT, University of 
Maastricht, The Netherlands. Paper presented at "Organisations, Innovation and Complexity: 
New Perspectives on the Knowledge Economy", 9th-10th September 2004, CRIC, University 
of Manchester, Manchester, England, UK. 

Scotchmer, S. (2004). Innovation and Incentives. MIT Press. 

Seufert, A.; Schweitzer, F. (2007). Aggregate Behavior in an Evolutionary Network Model. 
International Journal of Modern Physics C 18(10). 

Sorenson, O.; Rivkin, J. W.; Fleming, L. (2006). Complexity, networks and knowledge flow. 
Research Policy 35. In press. 

Stadler, P.; Schuster, P. (1996). Permanence of sparse autocatalytic networks. 

Stanley, H.; Amaral, L.; Canning, D.; Gopikrishnan, P.; Lee, Y.; Liu, Y. (1999). Econophysics: 
Can physicists contribute to the science of economics? 

Steger, A. (ed.) (2001). Diskrete Strukturen 2.: Kombinatorik, Graphentheorie, Algebra. Springer 
Verlag. 

Steger, A.; Schickinger, T. (eds.) (2001). Diskrete Strukturen 1.: Kombinatorik, Graphentheorie, 
Algebra. Springer Verlag. 

Tirole, J. (1988). The Theory of Industrial Orgnization. MIT Press. 

Varian, H. R. (1996). Intermediate Microeconomics: A Modern Approach. WW Norton. 

Vega-Redondo, F. (2007). Complex Social Networks. Series: Econometric Society Monographs, 
Cambridge University Press. 



83/111 



Michael D. Konig, Stefano Battiston, Prank Schweitzer: Modeling Evolving Innovation Networks 
In: Innovation Networks - New Approaches in Modeling and Analyzing (Eds. A. Pyka, A. Scharnhorst) 

Heidelberg: Springer, 2008 



Von Hippel, E. (1987). Cooperation between Rivals: Informal Know-How Trading. Research 
Policy 16, 291-302. 

Von Hippel, E.; Von Krogh, G. (2003). Open Source Software and the Private-Collective Inno- 
vation Model: Issues for Organization Science. Organization Science 14(2), 209-223. 

Watts, D. J.; Strogatz, S. H. (1998). Collective Dynamics of Small- World Networks. Nature 393, 
440-442. 

Weitzman, M. L. (1998). Recombinant Growth. The Quarterly Journal of Economics 113(2), 
331-360. 

West, Douglas, B. (2001). Introduction to Graph Theory. Prentice-Hall, 2nd edn. 

Wilson, R. (1975). Informational Economics of Scale. Bell Journal of Economics 6, 184-195. 

Zenou, Y. (2006). Course on Networks: Theory and Applications. Lecture notes. 



84/111 



